2024-09-17T03:00:47.813 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T03:00:47.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:00:47.918 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/openfiletable} email: pdonnell@redhat.com first_in_suite: false job_id: '7908408' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgiMkoasa0pQlneuZ/Sw5xRhHoCJ9Kr+6M/qOKNYPuWLcrxar7XcfhWLqmVSB2L+5MTwzXwQYD52jaPueS31M0= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCb3SuKkLBDR00CgRcfbkFOkf/g8wr4CIZ9QxBPsxer+WaDVkFHEtLHkoRRmns+OjqymzAhBFfK9FRlF6bowv8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_openfiletable teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T03:00:47.918 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T03:00:47.918 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T03:00:47.919 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T03:00:47.920 INFO:teuthology.task.internal:Checking packages... 2024-09-17T03:00:47.941 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T03:00:47.941 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T03:00:47.941 INFO:teuthology.packaging:ref: None 2024-09-17T03:00:47.941 INFO:teuthology.packaging:tag: None 2024-09-17T03:00:47.941 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:00:47.941 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:00:47.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:00:48.087 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T03:00:48.088 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T03:00:48.097 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T03:00:48.098 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T03:00:48.142 INFO:teuthology.task.internal:Saving configuration 2024-09-17T03:00:48.159 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T03:00:48.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T03:00:48.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:55:34.729943', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgiMkoasa0pQlneuZ/Sw5xRhHoCJ9Kr+6M/qOKNYPuWLcrxar7XcfhWLqmVSB2L+5MTwzXwQYD52jaPueS31M0='} 2024-09-17T03:00:48.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:55:34.731840', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCb3SuKkLBDR00CgRcfbkFOkf/g8wr4CIZ9QxBPsxer+WaDVkFHEtLHkoRRmns+OjqymzAhBFfK9FRlF6bowv8='} 2024-09-17T03:00:48.218 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T03:00:48.230 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T03:00:48.230 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T03:00:48.230 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T03:00:48.312 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f973bbb7ac0>, signals=[15]) 2024-09-17T03:00:48.313 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T03:00:48.324 INFO:teuthology.task.internal:Opening connections... 2024-09-17T03:00:48.324 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:00:48.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:48.403 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:00:48.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:48.479 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T03:00:48.491 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-17T03:00:48.509 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-17T03:00:48.509 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-09-17T03:00:48.568 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:00:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:00:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:00:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:00:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:00:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:00:48.569 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-17T03:00:48.591 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-17T03:00:48.609 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-17T03:00:48.609 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-17T03:00:48.667 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-17T03:00:48.667 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-17T03:00:48.667 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-17T03:00:48.667 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:00:48.667 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:00:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:00:48.669 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:00:48.669 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:00:48.669 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:00:48.669 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-17T03:00:48.691 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T03:00:48.714 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T03:00:48.736 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T03:00:48.736 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:00:48.739 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:00:48.755 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T03:00:48.771 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T03:00:48.771 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:00:48.796 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:00:48.882 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T03:00:48.937 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T03:00:48.971 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T03:00:48.971 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-17T03:00:48.971 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-17T03:00:48.971 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:00:48.972 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:00:48.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:00:48.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T03:00:48.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:00:48.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T03:00:49.152 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:00:49.152 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T03:00:49.152 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-17T03:00:49.167 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:00:49.167 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T03:00:49.167 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-17T03:00:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:00:49.171 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:00:49.171 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T03:00:49.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum upgrade -y linux-firmware 2024-09-17T03:00:49.185 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:00:49.185 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:00:49.186 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T03:00:49.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum upgrade -y linux-firmware 2024-09-17T03:00:52.141 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.3 MB 00:01 2024-09-17T03:00:54.141 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-17T03:00:55.024 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.3 MB 00:04 2024-09-17T03:00:58.641 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-17T03:01:00.133 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-17T03:01:01.221 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T03:01:01.221 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-09-17T03:01:06.627 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T03:01:08.598 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-17T03:01:08.602 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-17T03:01:08.602 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 1 Package 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 388 M 2024-09-17T03:01:08.603 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-17T03:01:08.693 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-17T03:01:10.382 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-17T03:01:11.552 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T03:01:17.083 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:01:19.086 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 1 Package 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 388 M 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-17T03:01:27.051 INFO:teuthology.orchestra.run.smithi164.stdout:linux-firmware-20240905-146.el9.noarch.rpm 50 MB/s | 388 MB 00:07 2024-09-17T03:01:27.051 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:01:27.052 INFO:teuthology.orchestra.run.smithi164.stdout:Total 49 MB/s | 388 MB 00:07 2024-09-17T03:01:30.173 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-17T03:01:30.261 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-17T03:01:30.262 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-17T03:01:33.536 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-17T03:01:33.537 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-17T03:01:42.695 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-17T03:01:43.595 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:01:43.674 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:01:44.317 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:01:44.317 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:01:45.073 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-17T03:01:45.396 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T03:01:45.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:01:45.544 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T03:01:45.545 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T03:01:45.547 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-09-17T03:01:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17 03:01:51 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T03:01:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2024-09-17 03:01:51-- 2024-09-17T03:01:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 6.3s 2024-09-17T03:01:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-17T03:01:51.846 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T03:01:51.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T03:01:53.915 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying... ######################################## 2024-09-17T03:01:53.980 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing... ######################################## 2024-09-17T03:01:54.041 INFO:teuthology.orchestra.run.smithi164.stdout:Updating / installing... 2024-09-17T03:02:02.026 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T03:02:13.536 INFO:teuthology.orchestra.run.smithi153.stdout:linux-firmware-20240905-146.el9.noarch.rpm 6.0 MB/s | 388 MB 01:04 2024-09-17T03:02:13.536 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:02:13.537 INFO:teuthology.orchestra.run.smithi153.stdout:Total 6.0 MB/s | 388 MB 01:04 2024-09-17T03:02:16.655 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-17T03:02:16.747 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-17T03:02:16.747 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-17T03:02:20.036 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-17T03:02:20.036 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-17T03:02:29.436 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-17T03:02:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:02:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:02:30.659 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:02:30.659 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:02:31.445 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-17T03:02:31.769 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T03:02:31.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:02:31.926 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T03:02:31.927 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T03:02:31.930 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-09-17T03:02:38.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17 03:02:38 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T03:02:38.225 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-09-17 03:02:38-- 2024-09-17T03:02:38.225 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 6.3s 2024-09-17T03:02:38.226 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 343M in 6.0s (57.2 MB/s) 2024-09-17T03:02:38.228 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T03:02:38.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T03:02:40.294 INFO:teuthology.orchestra.run.smithi153.stdout:Verifying... ######################################## 2024-09-17T03:02:40.354 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing... ######################################## 2024-09-17T03:02:40.414 INFO:teuthology.orchestra.run.smithi153.stdout:Updating / installing... 2024-09-17T03:02:42.019 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T03:02:42.019 DEBUG:teuthology.orchestra.run.smithi164:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T03:02:42.109 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T03:02:42.110 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T03:02:42.111 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T03:02:42.112 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T03:02:42.113 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T03:02:42.114 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T03:02:42.115 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T03:02:42.116 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T03:02:42.117 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T03:02:42.118 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T03:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T03:02:42.120 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T03:02:42.121 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T03:02:42.122 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T03:02:42.123 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T03:02:42.124 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T03:02:42.125 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T03:02:42.126 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T03:02:42.127 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T03:02:42.128 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T03:02:42.129 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T03:02:42.130 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T03:02:42.131 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T03:02:42.132 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T03:02:42.133 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T03:02:42.134 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T03:02:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T03:02:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T03:02:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T03:02:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T03:02:42.139 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T03:02:42.140 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T03:02:42.141 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T03:02:42.142 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T03:02:42.143 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T03:02:42.144 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T03:02:42.145 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T03:02:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T03:02:42.147 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T03:02:42.148 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T03:02:42.149 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T03:02:42.150 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T03:02:42.151 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T03:02:42.152 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T03:02:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T03:02:42.154 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T03:02:42.155 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T03:02:42.156 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T03:02:42.157 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T03:02:42.158 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T03:02:42.159 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T03:02:42.160 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T03:02:42.161 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T03:02:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T03:02:42.163 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T03:02:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T03:02:42.165 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T03:02:42.166 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T03:02:42.167 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T03:02:42.168 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T03:02:42.169 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T03:02:42.170 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T03:02:42.171 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T03:02:42.172 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T03:02:42.173 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T03:02:42.174 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T03:02:42.175 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T03:02:42.176 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T03:02:42.177 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T03:02:42.178 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T03:02:42.179 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T03:02:42.180 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T03:02:42.181 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T03:02:42.182 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T03:02:42.183 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T03:02:42.184 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T03:02:42.185 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T03:02:42.186 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T03:02:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T03:02:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T03:02:42.189 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T03:02:42.190 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T03:02:42.191 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T03:02:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T03:02:42.193 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T03:02:42.194 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T03:02:42.195 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T03:02:42.196 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T03:02:42.197 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T03:02:42.198 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T03:02:42.199 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T03:02:42.200 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T03:02:42.201 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T03:02:42.202 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T03:02:42.203 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T03:02:42.204 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T03:02:42.205 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T03:02:42.206 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T03:02:42.207 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T03:02:42.208 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T03:02:42.209 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T03:02:42.210 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T03:02:42.211 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T03:02:42.212 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T03:02:42.213 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T03:02:42.214 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T03:02:42.215 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T03:02:42.216 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T03:02:42.217 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T03:02:42.218 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T03:02:42.219 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T03:02:42.220 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T03:02:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T03:02:42.222 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T03:02:42.223 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T03:02:42.224 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T03:02:42.225 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T03:02:42.226 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T03:02:42.227 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T03:02:42.228 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T03:02:42.229 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T03:02:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T03:02:42.231 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T03:02:42.232 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T03:02:42.233 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T03:02:42.234 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T03:02:42.235 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T03:02:42.236 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T03:02:42.237 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T03:02:42.238 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T03:02:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T03:02:42.240 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T03:02:42.241 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T03:02:42.242 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T03:02:42.243 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T03:02:42.244 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T03:02:42.245 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T03:02:42.246 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T03:02:42.247 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T03:02:42.248 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T03:02:42.249 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T03:02:42.250 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T03:02:42.251 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T03:02:42.252 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T03:02:42.253 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T03:02:42.254 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T03:02:42.255 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T03:02:42.256 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T03:02:42.257 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T03:02:42.258 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T03:02:42.259 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T03:02:42.260 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T03:02:42.261 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T03:02:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T03:02:42.263 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T03:02:42.264 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:02:42.269 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.269 DEBUG:teuthology.orchestra.run.smithi164:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout:for file in vmlinuz System.map config; do 2024-09-17T03:02:42.292 INFO:teuthology.orchestra.run.smithi164.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: fi 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.293 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-09-17T03:02:42.294 INFO:teuthology.orchestra.run.smithi164.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T03:02:42.294 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:02:42.294 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.294 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-09-17T03:02:42.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-17T03:02:42.368 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:02:42.369 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:02:42.370 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:02:42.370 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-17T03:02:42.370 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:02:42.370 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:02:42.371 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:02:42.371 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:42.371 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:02:42.965 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-17T03:02:44.383 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:02:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-17T03:02:44.414 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-17T03:02:44.430 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.0uqNze8btW 2024-09-17T03:02:44.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0uqNze8btW 2024-09-17T03:02:44.506 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.0uqNze8btW 2024-09-17T03:02:44.647 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.0uqNze8btW is 6KB 2024-09-17T03:02:44.696 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.0uqNze8btW 2024-09-17T03:02:44.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:02:44.774 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:02:44.774 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:02:44.774 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:02:44.774 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T03:02:44.776 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:02:44.926 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-17T03:02:48.406 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T03:03:14.929 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T03:03:14.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:03:14.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:03:28.344 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T03:03:28.345 DEBUG:teuthology.orchestra.run.smithi153:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T03:03:28.448 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.448 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.448 INFO:teuthology.orchestra.run.smithi153.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T03:03:28.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T03:03:28.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T03:03:28.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T03:03:28.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T03:03:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T03:03:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T03:03:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T03:03:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T03:03:28.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T03:03:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T03:03:28.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T03:03:28.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T03:03:28.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T03:03:28.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T03:03:28.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T03:03:28.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T03:03:28.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T03:03:28.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T03:03:28.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T03:03:28.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T03:03:28.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T03:03:28.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T03:03:28.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T03:03:28.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T03:03:28.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T03:03:28.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T03:03:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T03:03:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T03:03:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T03:03:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T03:03:28.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T03:03:28.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T03:03:28.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T03:03:28.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T03:03:28.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T03:03:28.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T03:03:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T03:03:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T03:03:28.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T03:03:28.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T03:03:28.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T03:03:28.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T03:03:28.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T03:03:28.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T03:03:28.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T03:03:28.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T03:03:28.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T03:03:28.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T03:03:28.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T03:03:28.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T03:03:28.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T03:03:28.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T03:03:28.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T03:03:28.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T03:03:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T03:03:28.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T03:03:28.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T03:03:28.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T03:03:28.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T03:03:28.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T03:03:28.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T03:03:28.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T03:03:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T03:03:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T03:03:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T03:03:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T03:03:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T03:03:28.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T03:03:28.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T03:03:28.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T03:03:28.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T03:03:28.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T03:03:28.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T03:03:28.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T03:03:28.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T03:03:28.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T03:03:28.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T03:03:28.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T03:03:28.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T03:03:28.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T03:03:28.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T03:03:28.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T03:03:28.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T03:03:28.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T03:03:28.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T03:03:28.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T03:03:28.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T03:03:28.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T03:03:28.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T03:03:28.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T03:03:28.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T03:03:28.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T03:03:28.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T03:03:28.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T03:03:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T03:03:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T03:03:28.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T03:03:28.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T03:03:28.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T03:03:28.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T03:03:28.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T03:03:28.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T03:03:28.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T03:03:28.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T03:03:28.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T03:03:28.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T03:03:28.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T03:03:28.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T03:03:28.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T03:03:28.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T03:03:28.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T03:03:28.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T03:03:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T03:03:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T03:03:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T03:03:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T03:03:28.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T03:03:28.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T03:03:28.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T03:03:28.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T03:03:28.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T03:03:28.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T03:03:28.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T03:03:28.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T03:03:28.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T03:03:28.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T03:03:28.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T03:03:28.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T03:03:28.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T03:03:28.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T03:03:28.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T03:03:28.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T03:03:28.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T03:03:28.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T03:03:28.499 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T03:03:28.500 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T03:03:28.501 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T03:03:28.502 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T03:03:28.503 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T03:03:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T03:03:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T03:03:28.506 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T03:03:28.507 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T03:03:28.508 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T03:03:28.509 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T03:03:28.510 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T03:03:28.511 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T03:03:28.512 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T03:03:28.513 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T03:03:28.514 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T03:03:28.515 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T03:03:28.516 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T03:03:28.517 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T03:03:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T03:03:28.519 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T03:03:28.520 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T03:03:28.521 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T03:03:28.522 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T03:03:28.523 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T03:03:28.524 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T03:03:28.525 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T03:03:28.526 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T03:03:28.527 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T03:03:28.528 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T03:03:28.529 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T03:03:28.530 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T03:03:28.531 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T03:03:28.532 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T03:03:28.533 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T03:03:28.534 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T03:03:28.535 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T03:03:28.536 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T03:03:28.537 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T03:03:28.538 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T03:03:28.539 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T03:03:28.540 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T03:03:28.541 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T03:03:28.542 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T03:03:28.543 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T03:03:28.544 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T03:03:28.545 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T03:03:28.546 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T03:03:28.547 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T03:03:28.548 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T03:03:28.549 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T03:03:28.550 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T03:03:28.551 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T03:03:28.552 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T03:03:28.553 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T03:03:28.554 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T03:03:28.555 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T03:03:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T03:03:28.557 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T03:03:28.558 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T03:03:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T03:03:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T03:03:28.561 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T03:03:28.562 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T03:03:28.563 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T03:03:28.564 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T03:03:28.565 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T03:03:28.566 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T03:03:28.567 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T03:03:28.568 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T03:03:28.569 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T03:03:28.570 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T03:03:28.571 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T03:03:28.572 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T03:03:28.573 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T03:03:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T03:03:28.575 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T03:03:28.576 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T03:03:28.577 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T03:03:28.578 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T03:03:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T03:03:28.580 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T03:03:28.581 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T03:03:28.582 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T03:03:28.583 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T03:03:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T03:03:28.585 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T03:03:28.586 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T03:03:28.587 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T03:03:28.588 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T03:03:28.589 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T03:03:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T03:03:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T03:03:28.592 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T03:03:28.593 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T03:03:28.594 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T03:03:28.595 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T03:03:28.596 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T03:03:28.597 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T03:03:28.598 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T03:03:28.599 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T03:03:28.600 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T03:03:28.601 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T03:03:28.602 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T03:03:28.603 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T03:03:28.604 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T03:03:28.605 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T03:03:28.606 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T03:03:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T03:03:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T03:03:28.609 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T03:03:28.610 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T03:03:28.611 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T03:03:28.612 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T03:03:28.613 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T03:03:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T03:03:28.615 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T03:03:28.616 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T03:03:28.617 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T03:03:28.618 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T03:03:28.619 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T03:03:28.620 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T03:03:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T03:03:28.622 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T03:03:28.623 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T03:03:28.624 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T03:03:28.625 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T03:03:28.626 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T03:03:28.627 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T03:03:28.628 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T03:03:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T03:03:28.630 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T03:03:28.631 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T03:03:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T03:03:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T03:03:28.634 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T03:03:28.635 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T03:03:28.636 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T03:03:28.637 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T03:03:28.638 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T03:03:28.639 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T03:03:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T03:03:28.641 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T03:03:28.642 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T03:03:28.643 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T03:03:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T03:03:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T03:03:28.646 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T03:03:28.647 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:03:28.651 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.652 DEBUG:teuthology.orchestra.run.smithi153:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T03:03:28.674 INFO:teuthology.orchestra.run.smithi153.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout:for file in vmlinuz System.map config; do 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout: fi 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-17T03:03:28.675 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:03:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.677 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-09-17T03:03:28.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 82.el9 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:03:28.750 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8274670 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:03:28.751 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:03:28.752 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:03:28.752 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:03:28.752 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-09-17T03:03:28.752 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:03:28.752 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:03:28.753 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:03:28.753 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:28.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:03:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-17T03:03:30.760 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:03:30.782 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-17T03:03:30.785 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-17T03:03:30.800 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.IQP68P3mAd 2024-09-17T03:03:30.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IQP68P3mAd 2024-09-17T03:03:30.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.IQP68P3mAd 2024-09-17T03:03:31.013 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.IQP68P3mAd is 6KB 2024-09-17T03:03:31.061 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.IQP68P3mAd 2024-09-17T03:03:31.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:03:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:03:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:03:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:03:31.139 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T03:03:31.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:03:31.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-17T03:03:33.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-17T03:03:42.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:03:42.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:03:45.505 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-17T03:03:57.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:03:57.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:04:01.304 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T03:04:01.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:04:01.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:04:19.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-17T03:04:28.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:04:28.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:04:31.841 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-17T03:04:43.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:04:43.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:04:57.533 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T03:05:02.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-17T03:05:12.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:05:12.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:05:12.882 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-17T03:05:13.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:05:13.387 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T03:05:13.387 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-17T03:05:13.421 INFO:teuthology.orchestra.run.smithi164.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:05:13.421 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:05:13.421 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:05:13.421 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:05:14.423 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:17.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:05:17.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:05:18.292 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-17T03:05:18.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:05:18.804 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T03:05:18.804 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-17T03:05:18.839 INFO:teuthology.orchestra.run.smithi153.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:05:18.839 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:05:18.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:05:18.840 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:05:19.843 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:19.843 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T03:05:19.851 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T03:05:19.851 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:05:19.855 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:05:19.894 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T03:05:19.904 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T03:05:19.939 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T03:05:19.939 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:05:19.943 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:05:19.992 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T03:05:19.998 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T03:05:19.998 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:05:20.020 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:05:20.125 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:05:20.141 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:05:20.149 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:05:20.168 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:05:20.171 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T03:05:20.181 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T03:05:20.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:05:20.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:05:20.242 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T03:05:20.265 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T03:05:20.265 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:05:20.269 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:05:20.304 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:05:20.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:05:20.482 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:05:20.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:05:20.616 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:05:20.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:05:20.686 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:05:20.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:05:20.830 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:05:20.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:05:20.964 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:05:20.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:05:21.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-17T03:05:21.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-17T03:05:21.133 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:05:21.147 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:05:21.619 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T03:05:21.628 INFO:teuthology.task.internal:Starting timer... 2024-09-17T03:05:21.628 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T03:05:21.689 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T03:05:21.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-09-17T03:05:21.844 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-09-17T03:05:21.847 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-17T03:05:21.937 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-17T03:05:21.942 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T03:05:21.942 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-09-17T03:05:21.986 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-09-17T03:05:21.987 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-17T03:05:22.053 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-17T03:05:22.053 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi153.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-09-17T03:05:22.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:05:22.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:05:22.113 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:05:22.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:05:22.171 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T03:05:22.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:05:22.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:05:22.296 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T03:05:22.306 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T03:05:22.308 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T03:05:22.422 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T03:05:22.434 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T03:05:22.435 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T03:10:03.998 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-17T03:10:03.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:10:04.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:10:04.093 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-17T03:10:04.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-17T03:10:04.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:10:04.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:10:04.298 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-17T03:10:04.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-17T03:10:04.411 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T03:10:04.422 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T03:10:04.422 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:10:04.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:10:04.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:10:04.427 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:10:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:10:04.512 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:10:04.513 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:10:04.542 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:10:04.565 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-09-17T03:10:04.589 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-09-17T03:10:04.592 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-17T03:10:04.616 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-17T03:10:04.618 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:10:04.646 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:10:04.648 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:10:04.675 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:10:04.739 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.746 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.771 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.778 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:10:04.779 INFO:teuthology.run_tasks:Running task install... 2024-09-17T03:10:04.787 DEBUG:teuthology.task.install:project ceph 2024-09-17T03:10:04.787 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T03:10:04.787 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T03:10:04.788 INFO:teuthology.task.install:Using flavor: default 2024-09-17T03:10:04.793 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T03:10:04.793 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T03:10:04.794 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:10:04.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:10:04.797 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:10:04.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:10:04.958 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:10:04.958 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:10:04.961 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:10:04.962 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:10:05.067 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:10:05.068 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:10:05.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:10:05.075 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:10:05.075 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:10:05.076 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:10:05.126 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:10:05.126 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:10:05.132 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:10:05.133 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:10:05.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:10:05.230 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:10:05.302 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:10:05.308 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:10:05.357 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-09-17T03:10:05.360 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-09-17T03:10:05.364 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-17T03:10:05.367 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-17T03:10:05.641 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-17T03:10:05.649 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-09-17T03:10:05.675 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:10:05.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:10:06.362 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-17T03:10:06.363 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-17T03:10:06.663 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T03:10:06.689 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 86 kB/s | 24 kB 00:00 2024-09-17T03:10:06.938 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T03:10:06.973 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T03:10:07.488 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-17T03:10:07.515 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-17T03:10:09.483 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-17T03:10:10.790 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-17T03:10:15.499 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-17T03:10:16.400 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-17T03:10:17.299 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T03:10:17.951 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-17T03:10:18.195 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T03:10:18.789 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-17T03:10:24.776 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T03:10:25.177 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:10:27.100 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.100 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.116 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:10:27.116 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.116 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:10:27.116 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.117 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:10:27.120 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.121 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.187 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:10:27.209 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:10:27.210 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:10:27.211 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:10:27.212 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:10:27.213 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:10:27.214 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:10:27.215 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:10:27.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:10:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:10:27.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:10:27.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:10:27.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:10:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:10:27.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:10:27.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:10:27.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:10:27.224 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout:Install 149 Packages 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 8 Packages 2024-09-17T03:10:27.225 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:10:27.226 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 228 M 2024-09-17T03:10:27.226 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-17T03:10:27.515 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.516 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.528 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:10:27.529 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:10:27.529 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:10:27.530 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.532 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:10:27.534 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.535 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:10:27.585 INFO:teuthology.orchestra.run.smithi153.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-17T03:10:27.603 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:10:27.624 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:10:27.625 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:10:27.626 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:10:27.627 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-17T03:10:27.628 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:10:27.628 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:10:27.628 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:10:27.628 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:10:27.628 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:10:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:10:27.630 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:10:27.631 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:10:27.632 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:10:27.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:10:27.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:10:27.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:10:27.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:10:27.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:10:27.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:10:27.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:10:27.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:10:27.637 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:10:27.637 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:10:27.637 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:10:27.637 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:10:27.637 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:10:27.638 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:10:27.639 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:10:27.640 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:10:27.641 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:10:27.641 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:10:27.641 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:10:27.641 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:10:27.641 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-17T03:10:27.642 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-17T03:10:27.643 INFO:teuthology.orchestra.run.smithi164.stdout:Install 149 Packages 2024-09-17T03:10:27.643 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 8 Packages 2024-09-17T03:10:27.643 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:10:27.644 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 228 M 2024-09-17T03:10:27.644 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-17T03:10:27.760 INFO:teuthology.orchestra.run.smithi153.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-17T03:10:27.844 INFO:teuthology.orchestra.run.smithi153.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.7 MB/s | 148 kB 00:00 2024-09-17T03:10:28.019 INFO:teuthology.orchestra.run.smithi153.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 9.8 MB/s | 5.5 MB 00:00 2024-09-17T03:10:28.095 INFO:teuthology.orchestra.run.smithi153.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-09-17T03:10:28.145 INFO:teuthology.orchestra.run.smithi153.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-17T03:10:28.470 INFO:teuthology.orchestra.run.smithi164.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-17T03:10:28.579 INFO:teuthology.orchestra.run.smithi153.stdout:(7/157): ceph-common-19.3.0-4989.gce1b342b.el9. 18 MB/s | 20 MB 00:01 2024-09-17T03:10:28.646 INFO:teuthology.orchestra.run.smithi164.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-17T03:10:28.654 INFO:teuthology.orchestra.run.smithi153.stdout:(8/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 8.9 MB/s | 5.0 MB 00:00 2024-09-17T03:10:28.737 INFO:teuthology.orchestra.run.smithi164.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.6 MB/s | 148 kB 00:00 2024-09-17T03:10:28.763 INFO:teuthology.orchestra.run.smithi153.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 233 kB/s | 25 kB 00:00 2024-09-17T03:10:28.963 INFO:teuthology.orchestra.run.smithi164.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 8.9 MB/s | 5.5 MB 00:00 2024-09-17T03:10:29.221 INFO:teuthology.orchestra.run.smithi164.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 4.7 MB/s | 2.3 MB 00:00 2024-09-17T03:10:29.263 INFO:teuthology.orchestra.run.smithi164.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-09-17T03:10:29.583 INFO:teuthology.orchestra.run.smithi153.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 10 MB/s | 10 MB 00:01 2024-09-17T03:10:29.671 INFO:teuthology.orchestra.run.smithi153.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 2.5 MB/s | 225 kB 00:00 2024-09-17T03:10:29.747 INFO:teuthology.orchestra.run.smithi153.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 362 kB/s | 27 kB 00:00 2024-09-17T03:10:29.814 INFO:teuthology.orchestra.run.smithi153.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 479 kB/s | 32 kB 00:00 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi164.stdout:(7/157): ceph-common-19.3.0-4989.gce1b342b.el9. 12 MB/s | 20 MB 00:01 2024-09-17T03:10:29.989 INFO:teuthology.orchestra.run.smithi153.stdout:(14/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 9.7 MB/s | 18 MB 00:01 2024-09-17T03:10:30.031 INFO:teuthology.orchestra.run.smithi153.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 3.4 MB/s | 766 kB 00:00 2024-09-17T03:10:30.056 INFO:teuthology.orchestra.run.smithi153.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.3 MB/s | 159 kB 00:00 2024-09-17T03:10:30.081 INFO:teuthology.orchestra.run.smithi153.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T03:10:30.089 INFO:teuthology.orchestra.run.smithi164.stdout:(8/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 5.7 MB/s | 5.0 MB 00:00 2024-09-17T03:10:30.131 INFO:teuthology.orchestra.run.smithi153.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 6.6 MB/s | 507 kB 00:00 2024-09-17T03:10:30.173 INFO:teuthology.orchestra.run.smithi164.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 303 kB/s | 25 kB 00:00 2024-09-17T03:10:30.215 INFO:teuthology.orchestra.run.smithi153.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 542 kB/s | 45 kB 00:00 2024-09-17T03:10:30.315 INFO:teuthology.orchestra.run.smithi153.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.4 MB/s | 143 kB 00:00 2024-09-17T03:10:30.407 INFO:teuthology.orchestra.run.smithi153.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.7 MB/s | 162 kB 00:00 2024-09-17T03:10:30.524 INFO:teuthology.orchestra.run.smithi153.stdout:(22/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-17T03:10:30.549 INFO:teuthology.orchestra.run.smithi153.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 2.2 MB/s | 321 kB 00:00 2024-09-17T03:10:30.608 INFO:teuthology.orchestra.run.smithi153.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 3.6 MB/s | 305 kB 00:00 2024-09-17T03:10:30.636 INFO:teuthology.orchestra.run.smithi153.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T03:10:30.692 INFO:teuthology.orchestra.run.smithi153.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-17T03:10:30.776 INFO:teuthology.orchestra.run.smithi153.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-17T03:10:30.831 INFO:teuthology.orchestra.run.smithi164.stdout:(10/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 18 MB 00:01 2024-09-17T03:10:30.851 INFO:teuthology.orchestra.run.smithi153.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 456 kB/s | 34 kB 00:00 2024-09-17T03:10:30.918 INFO:teuthology.orchestra.run.smithi153.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 2.3 MB/s | 154 kB 00:00 2024-09-17T03:10:30.981 INFO:teuthology.orchestra.run.smithi164.stdout:(11/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 11 MB/s | 10 MB 00:00 2024-09-17T03:10:31.006 INFO:teuthology.orchestra.run.smithi164.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.3 MB/s | 225 kB 00:00 2024-09-17T03:10:31.048 INFO:teuthology.orchestra.run.smithi164.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 407 kB/s | 27 kB 00:00 2024-09-17T03:10:31.085 INFO:teuthology.orchestra.run.smithi153.stdout:(30/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 6.9 MB/s | 3.1 MB 00:00 2024-09-17T03:10:31.099 INFO:teuthology.orchestra.run.smithi164.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 344 kB/s | 32 kB 00:00 2024-09-17T03:10:31.191 INFO:teuthology.orchestra.run.smithi164.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 5.3 MB/s | 766 kB 00:00 2024-09-17T03:10:31.216 INFO:teuthology.orchestra.run.smithi164.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.3 MB/s | 159 kB 00:00 2024-09-17T03:10:31.266 INFO:teuthology.orchestra.run.smithi164.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 1.7 MB/s | 127 kB 00:00 2024-09-17T03:10:31.308 INFO:teuthology.orchestra.run.smithi164.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 5.4 MB/s | 507 kB 00:00 2024-09-17T03:10:31.392 INFO:teuthology.orchestra.run.smithi164.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 542 kB/s | 45 kB 00:00 2024-09-17T03:10:31.493 INFO:teuthology.orchestra.run.smithi164.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.4 MB/s | 143 kB 00:00 2024-09-17T03:10:31.584 INFO:teuthology.orchestra.run.smithi164.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.7 MB/s | 162 kB 00:00 2024-09-17T03:10:31.676 INFO:teuthology.orchestra.run.smithi164.stdout:(22/157): python3-rados-19.3.0-4989.gce1b342b.e 3.4 MB/s | 321 kB 00:00 2024-09-17T03:10:31.776 INFO:teuthology.orchestra.run.smithi164.stdout:(23/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 10 MB/s | 5.3 MB 00:00 2024-09-17T03:10:31.785 INFO:teuthology.orchestra.run.smithi153.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 16 MB/s | 14 MB 00:00 2024-09-17T03:10:31.835 INFO:teuthology.orchestra.run.smithi164.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 305 kB 00:00 2024-09-17T03:10:31.860 INFO:teuthology.orchestra.run.smithi164.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T03:10:31.885 INFO:teuthology.orchestra.run.smithi164.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T03:10:31.944 INFO:teuthology.orchestra.run.smithi164.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-17T03:10:32.028 INFO:teuthology.orchestra.run.smithi164.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 19 MB/s | 3.1 MB 00:00 2024-09-17T03:10:32.053 INFO:teuthology.orchestra.run.smithi164.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 315 kB/s | 34 kB 00:00 2024-09-17T03:10:32.078 INFO:teuthology.orchestra.run.smithi164.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T03:10:32.169 INFO:teuthology.orchestra.run.smithi153.stdout:(32/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 12 MB/s | 40 MB 00:03 2024-09-17T03:10:32.202 INFO:teuthology.orchestra.run.smithi153.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4989.gce 697 kB/s | 291 kB 00:00 2024-09-17T03:10:32.264 INFO:teuthology.orchestra.run.smithi153.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 523 kB/s | 49 kB 00:00 2024-09-17T03:10:32.295 INFO:teuthology.orchestra.run.smithi153.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 179 kB/s | 16 kB 00:00 2024-09-17T03:10:32.395 INFO:teuthology.orchestra.run.smithi153.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 5.6 MB/s | 7.4 MB 00:01 2024-09-17T03:10:32.429 INFO:teuthology.orchestra.run.smithi153.stdout:(37/157): ceph-volume-19.3.0-4989.gce1b342b.el9 1.7 MB/s | 285 kB 00:00 2024-09-17T03:10:32.462 INFO:teuthology.orchestra.run.smithi153.stdout:(38/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 4.6 MB/s | 784 kB 00:00 2024-09-17T03:10:32.496 INFO:teuthology.orchestra.run.smithi153.stdout:(39/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 182 kB/s | 18 kB 00:00 2024-09-17T03:10:32.513 INFO:teuthology.orchestra.run.smithi164.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-17T03:10:32.579 INFO:teuthology.orchestra.run.smithi164.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T03:10:32.629 INFO:teuthology.orchestra.run.smithi164.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 993 kB/s | 49 kB 00:00 2024-09-17T03:10:32.671 INFO:teuthology.orchestra.run.smithi164.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 396 kB/s | 16 kB 00:00 2024-09-17T03:10:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:(35/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 18 MB/s | 14 MB 00:00 2024-09-17T03:10:32.838 INFO:teuthology.orchestra.run.smithi153.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 195 kB/s | 80 kB 00:00 2024-09-17T03:10:32.855 INFO:teuthology.orchestra.run.smithi164.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 1.5 MB/s | 285 kB 00:00 2024-09-17T03:10:32.889 INFO:teuthology.orchestra.run.smithi164.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 13 MB/s | 784 kB 00:00 2024-09-17T03:10:32.931 INFO:teuthology.orchestra.run.smithi164.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 242 kB/s | 18 kB 00:00 2024-09-17T03:10:33.005 INFO:teuthology.orchestra.run.smithi153.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-09-17T03:10:33.073 INFO:teuthology.orchestra.run.smithi164.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-17T03:10:33.114 INFO:teuthology.orchestra.run.smithi164.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-17T03:10:33.156 INFO:teuthology.orchestra.run.smithi164.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T03:10:33.215 INFO:teuthology.orchestra.run.smithi164.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-17T03:10:33.299 INFO:teuthology.orchestra.run.smithi164.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-17T03:10:33.347 INFO:teuthology.orchestra.run.smithi153.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 498 kB/s | 253 kB 00:00 2024-09-17T03:10:33.349 INFO:teuthology.orchestra.run.smithi164.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-17T03:10:33.374 INFO:teuthology.orchestra.run.smithi164.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-17T03:10:33.405 INFO:teuthology.orchestra.run.smithi153.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 850 kB/s | 801 kB 00:00 2024-09-17T03:10:33.416 INFO:teuthology.orchestra.run.smithi164.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-17T03:10:33.458 INFO:teuthology.orchestra.run.smithi164.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-17T03:10:33.789 INFO:teuthology.orchestra.run.smithi153.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 241 kB/s | 106 kB 00:00 2024-09-17T03:10:33.822 INFO:teuthology.orchestra.run.smithi153.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.5 MB/s | 1.2 MB 00:00 2024-09-17T03:10:33.848 INFO:teuthology.orchestra.run.smithi153.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 306 kB/s | 135 kB 00:00 2024-09-17T03:10:33.976 INFO:teuthology.orchestra.run.smithi164.stdout:(48/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 10 MB/s | 40 MB 00:03 2024-09-17T03:10:34.231 INFO:teuthology.orchestra.run.smithi153.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 282 kB/s | 125 kB 00:00 2024-09-17T03:10:34.331 INFO:teuthology.orchestra.run.smithi153.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 422 kB/s | 215 kB 00:00 2024-09-17T03:10:34.359 INFO:teuthology.orchestra.run.smithi164.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 731 kB/s | 689 kB 00:00 2024-09-17T03:10:34.407 INFO:teuthology.orchestra.run.smithi153.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 689 kB 00:00 2024-09-17T03:10:34.434 INFO:teuthology.orchestra.run.smithi164.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-17T03:10:34.465 INFO:teuthology.orchestra.run.smithi153.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-17T03:10:34.468 INFO:teuthology.orchestra.run.smithi164.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 199 kB/s | 22 kB 00:00 2024-09-17T03:10:34.535 INFO:teuthology.orchestra.run.smithi164.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 876 kB/s | 943 kB 00:01 2024-09-17T03:10:34.577 INFO:teuthology.orchestra.run.smithi164.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-17T03:10:34.590 INFO:teuthology.orchestra.run.smithi153.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-09-17T03:10:34.624 INFO:teuthology.orchestra.run.smithi153.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 366 kB/s | 107 kB 00:00 2024-09-17T03:10:34.658 INFO:teuthology.orchestra.run.smithi153.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-17T03:10:34.694 INFO:teuthology.orchestra.run.smithi164.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-17T03:10:34.725 INFO:teuthology.orchestra.run.smithi153.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-17T03:10:34.792 INFO:teuthology.orchestra.run.smithi153.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 168 kB/s | 11 kB 00:00 2024-09-17T03:10:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 96 kB/s | 11 kB 00:00 2024-09-17T03:10:34.844 INFO:teuthology.orchestra.run.smithi164.stdout:(56/157): flex-2.6.4-9.el9.x86_64.rpm 765 kB/s | 313 kB 00:00 2024-09-17T03:10:34.900 INFO:teuthology.orchestra.run.smithi153.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-17T03:10:34.928 INFO:teuthology.orchestra.run.smithi164.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-17T03:10:34.961 INFO:teuthology.orchestra.run.smithi164.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-17T03:10:34.964 INFO:teuthology.orchestra.run.smithi153.stdout:(57/157): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-17T03:10:35.026 INFO:teuthology.orchestra.run.smithi153.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-17T03:10:35.036 INFO:teuthology.orchestra.run.smithi164.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-17T03:10:35.051 INFO:teuthology.orchestra.run.smithi153.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 522 kB/s | 45 kB 00:00 2024-09-17T03:10:35.235 INFO:teuthology.orchestra.run.smithi153.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-17T03:10:35.245 INFO:teuthology.orchestra.run.smithi164.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-17T03:10:35.260 INFO:teuthology.orchestra.run.smithi153.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-17T03:10:35.279 INFO:teuthology.orchestra.run.smithi164.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-17T03:10:35.302 INFO:teuthology.orchestra.run.smithi153.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 368 kB/s | 24 kB 00:00 2024-09-17T03:10:35.327 INFO:teuthology.orchestra.run.smithi153.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-17T03:10:35.354 INFO:teuthology.orchestra.run.smithi164.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-17T03:10:35.388 INFO:teuthology.orchestra.run.smithi164.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-17T03:10:35.419 INFO:teuthology.orchestra.run.smithi153.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-17T03:10:35.445 INFO:teuthology.orchestra.run.smithi153.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-17T03:10:35.471 INFO:teuthology.orchestra.run.smithi164.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-17T03:10:35.487 INFO:teuthology.orchestra.run.smithi153.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-17T03:10:35.522 INFO:teuthology.orchestra.run.smithi164.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-17T03:10:35.580 INFO:teuthology.orchestra.run.smithi164.stdout:(66/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-17T03:10:35.606 INFO:teuthology.orchestra.run.smithi164.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 287 kB/s | 38 kB 00:00 2024-09-17T03:10:35.687 INFO:teuthology.orchestra.run.smithi153.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-17T03:10:35.914 INFO:teuthology.orchestra.run.smithi164.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-09-17T03:10:36.073 INFO:teuthology.orchestra.run.smithi164.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-17T03:10:36.154 INFO:teuthology.orchestra.run.smithi153.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-09-17T03:10:36.215 INFO:teuthology.orchestra.run.smithi164.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 7.1 MB/s | 4.9 MB 00:00 2024-09-17T03:10:36.261 INFO:teuthology.orchestra.run.smithi164.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 730 kB/s | 137 kB 00:00 2024-09-17T03:10:36.391 INFO:teuthology.orchestra.run.smithi164.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.8 MB/s | 1.0 MB 00:00 2024-09-17T03:10:36.412 INFO:teuthology.orchestra.run.smithi153.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-17T03:10:36.488 INFO:teuthology.orchestra.run.smithi153.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-17T03:10:36.499 INFO:teuthology.orchestra.run.smithi164.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 810 kB/s | 87 kB 00:00 2024-09-17T03:10:36.688 INFO:teuthology.orchestra.run.smithi153.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-17T03:10:36.805 INFO:teuthology.orchestra.run.smithi153.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-17T03:10:36.863 INFO:teuthology.orchestra.run.smithi153.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-17T03:10:37.006 INFO:teuthology.orchestra.run.smithi153.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi153.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 491 kB/s | 61 kB 00:00 2024-09-17T03:10:37.248 INFO:teuthology.orchestra.run.smithi153.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T03:10:37.364 INFO:teuthology.orchestra.run.smithi153.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-17T03:10:37.431 INFO:teuthology.orchestra.run.smithi153.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 387 kB/s | 26 kB 00:00 2024-09-17T03:10:37.498 INFO:teuthology.orchestra.run.smithi153.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-09-17T03:10:37.565 INFO:teuthology.orchestra.run.smithi153.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-17T03:10:37.657 INFO:teuthology.orchestra.run.smithi153.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 380 kB/s | 35 kB 00:00 2024-09-17T03:10:37.866 INFO:teuthology.orchestra.run.smithi153.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-09-17T03:10:37.974 INFO:teuthology.orchestra.run.smithi153.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-17T03:10:38.050 INFO:teuthology.orchestra.run.smithi153.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-17T03:10:38.117 INFO:teuthology.orchestra.run.smithi153.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-17T03:10:38.192 INFO:teuthology.orchestra.run.smithi153.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 565 kB/s | 42 kB 00:00 2024-09-17T03:10:38.300 INFO:teuthology.orchestra.run.smithi153.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-17T03:10:38.417 INFO:teuthology.orchestra.run.smithi153.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-17T03:10:38.601 INFO:teuthology.orchestra.run.smithi153.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-17T03:10:38.710 INFO:teuthology.orchestra.run.smithi153.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-17T03:10:38.801 INFO:teuthology.orchestra.run.smithi153.stdout:(91/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-17T03:10:38.868 INFO:teuthology.orchestra.run.smithi153.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 338 kB/s | 54 kB 00:00 2024-09-17T03:10:38.944 INFO:teuthology.orchestra.run.smithi153.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-17T03:10:39.011 INFO:teuthology.orchestra.run.smithi153.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 665 kB/s | 44 kB 00:00 2024-09-17T03:10:39.086 INFO:teuthology.orchestra.run.smithi153.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-17T03:10:39.170 INFO:teuthology.orchestra.run.smithi153.stdout:(96/157): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-17T03:10:39.195 INFO:teuthology.orchestra.run.smithi153.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-17T03:10:39.237 INFO:teuthology.orchestra.run.smithi153.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-09-17T03:10:39.312 INFO:teuthology.orchestra.run.smithi153.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-17T03:10:39.346 INFO:teuthology.orchestra.run.smithi153.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-17T03:10:39.379 INFO:teuthology.orchestra.run.smithi153.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-17T03:10:39.455 INFO:teuthology.orchestra.run.smithi153.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 597 kB/s | 45 kB 00:00 2024-09-17T03:10:39.480 INFO:teuthology.orchestra.run.smithi153.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 476 kB/s | 64 kB 00:00 2024-09-17T03:10:39.564 INFO:teuthology.orchestra.run.smithi153.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-17T03:10:39.622 INFO:teuthology.orchestra.run.smithi153.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-17T03:10:39.656 INFO:teuthology.orchestra.run.smithi153.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T03:10:39.681 INFO:teuthology.orchestra.run.smithi153.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-09-17T03:10:39.765 INFO:teuthology.orchestra.run.smithi153.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-17T03:10:39.832 INFO:teuthology.orchestra.run.smithi153.stdout:(109/157): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-17T03:10:39.865 INFO:teuthology.orchestra.run.smithi153.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-17T03:10:39.890 INFO:teuthology.orchestra.run.smithi153.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-09-17T03:10:39.916 INFO:teuthology.orchestra.run.smithi153.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-17T03:10:39.941 INFO:teuthology.orchestra.run.smithi153.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-17T03:10:39.975 INFO:teuthology.orchestra.run.smithi153.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-17T03:10:40.000 INFO:teuthology.orchestra.run.smithi153.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T03:10:40.034 INFO:teuthology.orchestra.run.smithi153.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-17T03:10:40.059 INFO:teuthology.orchestra.run.smithi153.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-17T03:10:40.084 INFO:teuthology.orchestra.run.smithi153.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-17T03:10:40.118 INFO:teuthology.orchestra.run.smithi153.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-17T03:10:40.151 INFO:teuthology.orchestra.run.smithi153.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-17T03:10:40.177 INFO:teuthology.orchestra.run.smithi153.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T03:10:40.211 INFO:teuthology.orchestra.run.smithi153.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-17T03:10:40.236 INFO:teuthology.orchestra.run.smithi153.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-17T03:10:40.261 INFO:teuthology.orchestra.run.smithi153.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-17T03:10:40.295 INFO:teuthology.orchestra.run.smithi153.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 531 kB/s | 18 kB 00:00 2024-09-17T03:10:40.353 INFO:teuthology.orchestra.run.smithi153.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 399 kB/s | 23 kB 00:00 2024-09-17T03:10:40.378 INFO:teuthology.orchestra.run.smithi153.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-17T03:10:40.404 INFO:teuthology.orchestra.run.smithi153.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-17T03:10:40.454 INFO:teuthology.orchestra.run.smithi153.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 21 MB/s | 1.0 MB 00:00 2024-09-17T03:10:40.479 INFO:teuthology.orchestra.run.smithi153.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T03:10:40.530 INFO:teuthology.orchestra.run.smithi153.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-17T03:10:40.555 INFO:teuthology.orchestra.run.smithi153.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-17T03:10:40.572 INFO:teuthology.orchestra.run.smithi153.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-17T03:10:40.597 INFO:teuthology.orchestra.run.smithi153.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-17T03:10:40.622 INFO:teuthology.orchestra.run.smithi153.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-17T03:10:40.648 INFO:teuthology.orchestra.run.smithi153.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-17T03:10:40.690 INFO:teuthology.orchestra.run.smithi153.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-09-17T03:10:40.715 INFO:teuthology.orchestra.run.smithi153.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-17T03:10:40.748 INFO:teuthology.orchestra.run.smithi153.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-17T03:10:40.774 INFO:teuthology.orchestra.run.smithi153.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-17T03:10:40.799 INFO:teuthology.orchestra.run.smithi153.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-17T03:10:40.824 INFO:teuthology.orchestra.run.smithi153.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-17T03:10:40.849 INFO:teuthology.orchestra.run.smithi153.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-17T03:10:40.875 INFO:teuthology.orchestra.run.smithi153.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T03:10:40.900 INFO:teuthology.orchestra.run.smithi153.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 811 kB/s | 20 kB 00:00 2024-09-17T03:10:40.934 INFO:teuthology.orchestra.run.smithi153.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T03:10:40.959 INFO:teuthology.orchestra.run.smithi153.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-17T03:10:41.065 INFO:teuthology.orchestra.run.smithi153.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-17T03:10:41.260 INFO:teuthology.orchestra.run.smithi153.stdout:(149/157): librados2-19.3.0-4989.gce1b342b.el9. 11 MB/s | 3.4 MB 00:00 2024-09-17T03:10:41.393 INFO:teuthology.orchestra.run.smithi153.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 9.6 MB/s | 3.2 MB 00:00 2024-09-17T03:10:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 763 kB/s | 4.4 MB 00:05 2024-09-17T03:10:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 1.1 MB/s | 5.8 MB 00:05 2024-09-17T03:10:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 568 kB/s | 61 kB 00:00 2024-09-17T03:10:41.742 INFO:teuthology.orchestra.run.smithi164.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-17T03:10:41.967 INFO:teuthology.orchestra.run.smithi164.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 114 kB/s | 26 kB 00:00 2024-09-17T03:10:41.992 INFO:teuthology.orchestra.run.smithi164.stdout:(79/157): python3-devel-3.9.19-8.el9.x86_64.rpm 624 kB/s | 245 kB 00:00 2024-09-17T03:10:42.075 INFO:teuthology.orchestra.run.smithi164.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-17T03:10:42.192 INFO:teuthology.orchestra.run.smithi164.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-17T03:10:42.244 INFO:teuthology.orchestra.run.smithi153.stdout:(151/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-17T03:10:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.0 MB/s | 1.8 MB 00:00 2024-09-17T03:10:42.301 INFO:teuthology.orchestra.run.smithi164.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 558 kB/s | 172 kB 00:00 2024-09-17T03:10:42.511 INFO:teuthology.orchestra.run.smithi153.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 153 kB/s | 41 kB 00:00 2024-09-17T03:10:42.643 INFO:teuthology.orchestra.run.smithi164.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 994 kB/s | 6.0 MB 00:06 2024-09-17T03:10:42.677 INFO:teuthology.orchestra.run.smithi164.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-17T03:10:42.803 INFO:teuthology.orchestra.run.smithi153.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 482 kB/s | 249 kB 00:00 2024-09-17T03:10:42.898 INFO:teuthology.orchestra.run.smithi164.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 348 kB/s | 77 kB 00:00 2024-09-17T03:10:43.019 INFO:teuthology.orchestra.run.smithi164.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 351 kB/s | 42 kB 00:00 2024-09-17T03:10:43.028 INFO:teuthology.orchestra.run.smithi153.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 1.3 MB/s | 2.3 MB 00:01 2024-09-17T03:10:43.044 INFO:teuthology.orchestra.run.smithi164.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 555 kB/s | 222 kB 00:00 2024-09-17T03:10:43.336 INFO:teuthology.orchestra.run.smithi164.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-09-17T03:10:43.486 INFO:teuthology.orchestra.run.smithi164.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-17T03:10:43.504 INFO:teuthology.orchestra.run.smithi153.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-17T03:10:43.586 INFO:teuthology.orchestra.run.smithi164.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 511 kB/s | 51 kB 00:00 2024-09-17T03:10:43.587 INFO:teuthology.orchestra.run.smithi153.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 2.4 MB 00:00 2024-09-17T03:10:43.594 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:10:43.594 INFO:teuthology.orchestra.run.smithi153.stdout:Total 14 MB/s | 228 MB 00:16 2024-09-17T03:10:43.695 INFO:teuthology.orchestra.run.smithi164.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-17T03:10:43.812 INFO:teuthology.orchestra.run.smithi164.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 586 kB/s | 279 kB 00:00 2024-09-17T03:10:43.912 INFO:teuthology.orchestra.run.smithi164.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-09-17T03:10:44.021 INFO:teuthology.orchestra.run.smithi164.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-17T03:10:44.405 INFO:teuthology.orchestra.run.smithi164.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 576 kB/s | 221 kB 00:00 2024-09-17T03:10:44.513 INFO:teuthology.orchestra.run.smithi164.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-09-17T03:10:44.622 INFO:teuthology.orchestra.run.smithi164.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 439 kB/s | 47 kB 00:00 2024-09-17T03:10:45.116 INFO:teuthology.orchestra.run.smithi164.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 615 kB/s | 304 kB 00:00 2024-09-17T03:10:45.231 INFO:teuthology.orchestra.run.smithi164.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 506 kB/s | 58 kB 00:00 2024-09-17T03:10:45.431 INFO:teuthology.orchestra.run.smithi164.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-17T03:10:45.623 INFO:teuthology.orchestra.run.smithi164.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-17T03:10:45.667 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-17T03:10:45.723 INFO:teuthology.orchestra.run.smithi164.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-09-17T03:10:45.824 INFO:teuthology.orchestra.run.smithi164.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 224 kB/s | 22 kB 00:00 2024-09-17T03:10:45.853 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-17T03:10:45.853 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-17T03:10:46.049 INFO:teuthology.orchestra.run.smithi164.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.8 MB/s | 863 kB 00:00 2024-09-17T03:10:46.116 INFO:teuthology.orchestra.run.smithi164.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-17T03:10:46.149 INFO:teuthology.orchestra.run.smithi164.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T03:10:46.166 INFO:teuthology.orchestra.run.smithi164.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-17T03:10:46.292 INFO:teuthology.orchestra.run.smithi164.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-17T03:10:46.308 INFO:teuthology.orchestra.run.smithi164.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-17T03:10:46.325 INFO:teuthology.orchestra.run.smithi164.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-17T03:10:46.351 INFO:teuthology.orchestra.run.smithi164.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T03:10:46.377 INFO:teuthology.orchestra.run.smithi164.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-17T03:10:46.418 INFO:teuthology.orchestra.run.smithi164.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-17T03:10:46.460 INFO:teuthology.orchestra.run.smithi164.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-17T03:10:46.485 INFO:teuthology.orchestra.run.smithi164.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T03:10:46.511 INFO:teuthology.orchestra.run.smithi164.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T03:10:46.536 INFO:teuthology.orchestra.run.smithi164.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-17T03:10:46.602 INFO:teuthology.orchestra.run.smithi164.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.6 MB/s | 172 kB 00:00 2024-09-17T03:10:46.636 INFO:teuthology.orchestra.run.smithi164.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-17T03:10:46.670 INFO:teuthology.orchestra.run.smithi164.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.8 MB/s | 303 kB 00:00 2024-09-17T03:10:46.695 INFO:teuthology.orchestra.run.smithi164.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-17T03:10:46.771 INFO:teuthology.orchestra.run.smithi164.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-09-17T03:10:46.796 INFO:teuthology.orchestra.run.smithi164.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-17T03:10:46.821 INFO:teuthology.orchestra.run.smithi164.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-17T03:10:46.838 INFO:teuthology.orchestra.run.smithi164.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-17T03:10:46.855 INFO:teuthology.orchestra.run.smithi164.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-17T03:10:46.880 INFO:teuthology.orchestra.run.smithi164.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-17T03:10:46.897 INFO:teuthology.orchestra.run.smithi164.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-17T03:10:46.971 INFO:teuthology.orchestra.run.smithi164.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-09-17T03:10:46.998 INFO:teuthology.orchestra.run.smithi164.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.7 MB/s | 46 kB 00:00 2024-09-17T03:10:47.023 INFO:teuthology.orchestra.run.smithi164.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T03:10:47.048 INFO:teuthology.orchestra.run.smithi164.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T03:10:47.082 INFO:teuthology.orchestra.run.smithi164.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-17T03:10:47.108 INFO:teuthology.orchestra.run.smithi164.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-17T03:10:47.133 INFO:teuthology.orchestra.run.smithi164.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-17T03:10:47.158 INFO:teuthology.orchestra.run.smithi164.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-17T03:10:47.186 INFO:teuthology.orchestra.run.smithi164.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.1 MB/s | 31 kB 00:00 2024-09-17T03:10:47.211 INFO:teuthology.orchestra.run.smithi164.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-17T03:10:47.236 INFO:teuthology.orchestra.run.smithi164.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T03:10:47.262 INFO:teuthology.orchestra.run.smithi164.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-17T03:10:47.287 INFO:teuthology.orchestra.run.smithi164.stdout:(141/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-17T03:10:47.348 INFO:teuthology.orchestra.run.smithi164.stdout:(142/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.7 MB/s | 230 kB 00:00 2024-09-17T03:10:47.379 INFO:teuthology.orchestra.run.smithi164.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.9 MB/s | 90 kB 00:00 2024-09-17T03:10:47.413 INFO:teuthology.orchestra.run.smithi164.stdout:(144/157): python3-werkzeug-2.0.3-3.el9.1.noarc 13 MB/s | 427 kB 00:00 2024-09-17T03:10:47.438 INFO:teuthology.orchestra.run.smithi164.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-09-17T03:10:47.463 INFO:teuthology.orchestra.run.smithi164.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-17T03:10:47.522 INFO:teuthology.orchestra.run.smithi164.stdout:(147/157): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-17T03:10:47.822 INFO:teuthology.orchestra.run.smithi164.stdout:(148/157): librados2-19.3.0-4989.gce1b342b.el9. 11 MB/s | 3.4 MB 00:00 2024-09-17T03:10:48.014 INFO:teuthology.orchestra.run.smithi164.stdout:(149/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 17 MB/s | 3.2 MB 00:00 2024-09-17T03:10:48.228 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-17T03:10:48.228 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-17T03:10:48.548 INFO:teuthology.orchestra.run.smithi164.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.4 MB/s | 2.3 MB 00:00 2024-09-17T03:10:48.965 INFO:teuthology.orchestra.run.smithi164.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.3 MB/s | 1.8 MB 00:00 2024-09-17T03:10:49.007 INFO:teuthology.orchestra.run.smithi164.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 973 kB/s | 41 kB 00:00 2024-09-17T03:10:49.049 INFO:teuthology.orchestra.run.smithi164.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.9 MB/s | 249 kB 00:00 2024-09-17T03:10:49.133 INFO:teuthology.orchestra.run.smithi164.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-17T03:10:49.224 INFO:teuthology.orchestra.run.smithi164.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-17T03:10:50.108 INFO:teuthology.orchestra.run.smithi164.stdout:(156/157): python3-numpy-1.20.1-5.el9.x86_64.rp 659 kB/s | 5.1 MB 00:07 2024-09-17T03:10:55.017 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-17T03:10:55.150 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:10:55.201 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:10:55.266 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:10:55.310 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:10:55.343 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:10:55.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:10:55.782 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:10:55.922 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:10:56.085 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:10:56.119 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:10:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:10:56.262 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:10:56.306 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:10:56.526 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:10:56.589 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:10:56.615 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:10:56.735 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:10:56.767 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:10:56.849 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:10:56.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:10:56.916 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:10:57.178 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:10:57.358 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:10:57.579 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:10:57.696 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:10:57.809 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:10:58.090 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:10:58.227 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:10:58.264 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:10:58.309 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:10:58.392 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:10:58.474 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:10:58.509 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:10:58.563 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:10:58.602 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:10:58.635 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:10:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:10:58.787 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:10:58.823 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:10:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:10:59.001 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:10:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:10:59.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:10:59.316 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:10:59.484 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:10:59.545 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:11:00.186 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:11:00.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:11:00.393 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:11:00.431 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:11:00.559 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:11:00.959 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:11:01.078 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:11:01.186 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:11:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:11:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:11:01.346 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:11:01.405 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:11:01.454 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:11:01.500 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:11:01.550 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:11:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:11:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:11:01.813 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:11:01.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:11:01.995 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:11:02.054 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:11:02.083 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:11:02.108 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:11:02.224 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:11:02.376 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:11:02.425 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:11:02.465 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:11:02.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:11:02.545 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:11:02.592 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:11:02.629 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:11:02.664 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:11:02.696 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:11:02.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:11:02.773 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:11:02.874 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:11:02.956 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:11:03.001 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:11:03.124 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:11:03.189 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:11:04.084 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:11:04.133 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:11:04.166 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:11:04.280 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:11:04.349 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:11:04.402 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:11:04.498 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:11:04.535 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:11:04.774 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:11:04.809 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:11:04.902 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:11:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:11:05.865 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:11:07.451 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:11:07.554 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:11:07.573 INFO:teuthology.orchestra.run.smithi164.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 697 kB/s | 16 MB 00:23 2024-09-17T03:11:07.577 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:11:07.577 INFO:teuthology.orchestra.run.smithi164.stdout:Total 5.7 MB/s | 228 MB 00:39 2024-09-17T03:11:07.591 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:11:07.650 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:11:07.978 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:11:08.018 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:11:08.139 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:11:08.549 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:11:08.601 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:11:09.147 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:11:09.188 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:11:09.287 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:11:09.314 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:11:09.657 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-17T03:11:09.843 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-17T03:11:09.843 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-17T03:11:11.838 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:11.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:12.243 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-17T03:11:12.243 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-17T03:11:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:12.706 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:11:12.729 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:11:12.729 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:11:12.729 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:11:12.729 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:11:18.926 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-17T03:11:19.061 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:11:19.111 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:11:19.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:11:19.255 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:11:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:11:19.344 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:11:19.730 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:11:19.854 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:11:20.005 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:11:20.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:11:20.152 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:11:20.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:11:20.235 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:11:20.453 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:11:20.517 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:11:20.543 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:11:20.681 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:11:20.728 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:11:20.794 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:11:20.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:11:20.863 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:11:21.081 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:11:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:11:21.523 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:11:21.638 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:11:21.755 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:11:22.065 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:11:22.209 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:11:22.276 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:11:22.322 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:11:22.412 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:11:22.474 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:11:22.513 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:11:22.568 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:11:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:11:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:11:22.752 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:11:22.809 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:11:22.843 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:11:22.890 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:11:22.970 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:11:23.022 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:11:23.066 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:11:23.094 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:11:23.177 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:11:23.230 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:11:23.320 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:11:23.503 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:11:23.567 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:11:24.200 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:11:24.308 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:11:24.345 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:11:24.389 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:11:24.427 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:11:24.514 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:11:24.689 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:11:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:11:24.851 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:11:24.931 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:11:25.018 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:11:25.073 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:11:25.110 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:11:25.167 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:11:25.234 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:11:25.279 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:11:25.330 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:11:25.502 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:11:25.582 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-09-17T03:11:25.617 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-09-17T03:11:25.618 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:25.634 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:11:25.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:11:25.808 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:11:25.824 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:11:25.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:11:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:11:25.860 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:25.860 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:11:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:25.889 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:11:25.936 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:11:26.075 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:11:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:11:26.293 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:11:26.350 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:11:26.384 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:11:26.425 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:11:26.463 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:11:26.501 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:11:26.536 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:11:26.569 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:11:26.613 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:11:26.646 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:11:26.777 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:11:26.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:11:26.874 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:11:26.995 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:11:27.055 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:11:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:11:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:27.937 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:11:27.951 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:11:27.988 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:11:27.989 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:27.989 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:11:27.989 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:11:27.989 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:11:27.989 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:28.017 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:11:28.051 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:11:28.163 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:11:28.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:11:28.288 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:11:28.384 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:11:28.428 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:11:28.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:11:28.556 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:11:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:11:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:11:28.556 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:11:28.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:28.668 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:11:28.697 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:11:28.700 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:11:28.774 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:11:28.796 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:11:28.837 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:11:29.062 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:11:29.125 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:11:29.211 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:11:29.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:11:29.493 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:11:29.542 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:11:29.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:11:29.611 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:11:29.632 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:11:29.773 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:11:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:11:30.189 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:11:30.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:11:30.312 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:11:30.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:11:31.335 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:11:31.432 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:11:31.468 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:11:31.521 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:11:31.882 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:11:31.929 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:11:32.042 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:11:32.078 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:11:32.132 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:11:32.674 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:11:32.708 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:11:32.799 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:11:32.828 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:11:34.004 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:11:34.098 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:11:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:11:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:11:35.363 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:35.370 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:11:35.397 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:11:35.586 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:11:35.637 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:11:35.637 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:35.637 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:11:35.637 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:11:35.638 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:11:35.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:35.695 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:11:35.722 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:11:35.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:11:35.925 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:11:36.056 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:11:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:11:36.239 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:11:36.239 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:11:36.239 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:11:36.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:36.294 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:11:36.971 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:11:37.006 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:11:37.058 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:37.107 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:11:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:11:37.157 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:37.157 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:11:37.157 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:37.207 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:11:37.258 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:11:37.258 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:37.258 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:11:37.259 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:11:37.259 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:11:37.259 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:37.625 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:11:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:11:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:11:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:11:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:11:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:42.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:11:42.062 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:11:42.106 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:11:42.160 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:11:42.195 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:11:42.442 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:11:42.491 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:11:42.521 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:11:42.553 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:11:42.605 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:11:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:11:43.361 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:11:43.402 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:11:44.733 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:11:44.872 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:11:44.932 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:11:45.052 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:11:45.095 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:11:45.120 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:11:45.156 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:11:45.157 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:11:45.264 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:11:45.265 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:11:45.373 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:11:45.397 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:11:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:11:45.413 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:11:45.658 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:11:45.658 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:11:45.776 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:11:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:11:46.045 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:11:46.045 INFO:teuthology.orchestra.run.smithi153.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T03:11:46.045 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-17T03:11:48.958 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:49.174 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:11:49.211 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:11:49.212 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:49.212 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:11:49.212 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:50.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:11:50.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:51.236 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:11:51.288 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:51.803 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:11:51.855 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:11:51.855 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:51.855 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:11:51.855 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:11:51.855 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:11:51.856 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:51.987 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:11:52.046 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:11:52.111 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:11:52.245 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:11:52.245 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:11:52.245 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:11:52.245 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:11:52.246 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:11:52.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:11:52.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:11:52.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:11:52.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:11:52.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:11:52.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:11:52.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:11:52.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:11:52.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:11:52.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:11:52.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:11:52.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:11:52.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:11:52.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:11:52.262 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:11:52.263 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:11:52.336 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:11:52.391 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:11:52.477 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:11:52.584 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:11:52.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:11:52.803 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:11:52.838 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:11:52.873 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:11:53.352 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:11:53.389 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:11:53.431 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:11:53.512 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:11:53.544 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:11:54.382 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-17T03:11:54.383 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.384 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.385 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:11:54.386 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:11:54.387 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:11:54.388 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:11:54.389 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:11:54.390 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:11:54.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:11:54.392 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:11:54.393 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:11:54.394 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:11:54.395 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:11:54.396 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-17T03:11:55.118 DEBUG:teuthology.parallel:result is None 2024-09-17T03:11:57.168 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:11:57.234 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:11:58.320 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:11:58.351 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:11:58.502 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:11:58.688 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:11:58.728 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:11:58.780 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:11:58.837 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:11:58.864 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:11:58.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:11:59.040 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:12:00.099 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:12:00.131 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:12:00.183 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:00.241 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:12:00.290 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:12:00.290 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:12:00.290 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:12:00.290 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:00.366 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:12:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:12:00.417 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:12:00.417 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:12:00.417 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:12:00.418 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:12:00.418 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:00.775 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:12:00.827 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:12:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:12:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:12:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:12:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:12:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:12:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:12:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:12:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:12:06.504 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:12:06.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:12:06.598 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:12:07.924 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:12:08.037 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:12:08.126 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:12:08.237 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:12:08.273 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:12:08.307 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:12:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:12:08.343 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:12:08.484 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:12:08.484 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:12:08.593 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:12:08.617 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:12:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:12:08.633 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:12:08.878 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:12:08.878 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:12:08.996 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:12:09.069 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:12:09.266 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:12:09.266 INFO:teuthology.orchestra.run.smithi164.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T03:12:09.266 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:15.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:12:15.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:12:15.628 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:12:15.629 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:12:15.642 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:12:15.642 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:12:15.642 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:12:15.642 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:12:15.642 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:12:15.643 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:12:15.644 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:12:15.645 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:12:15.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:12:15.647 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:12:15.648 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:12:15.649 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:12:15.650 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:12:15.651 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:12:15.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:12:15.653 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:12:17.894 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:12:17.894 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:17.894 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:12:17.895 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.896 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.897 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:12:17.898 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.899 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:12:17.900 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.901 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:12:17.902 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:12:17.903 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:12:17.904 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:12:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:12:17.906 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:17.907 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-17T03:12:18.590 DEBUG:teuthology.parallel:result is None 2024-09-17T03:12:18.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:12:18.738 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:12:18.788 INFO:teuthology.orchestra.run.smithi153.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:12:18.789 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:12:18.789 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:12:18.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:12:18.937 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:12:18.984 INFO:teuthology.orchestra.run.smithi164.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:12:18.985 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:12:18.985 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:12:18.987 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T03:12:18.987 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:18.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:12:19.051 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:19.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:12:19.111 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T03:12:19.112 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:19.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:12:19.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:12:19.265 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:19.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:12:19.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:12:19.420 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T03:12:19.421 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:19.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:12:19.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:12:19.573 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:20.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:12:20.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:12:20.421 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T03:12:20.421 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:20.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:12:20.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:12:20.582 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:20.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:12:20.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:12:20.737 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T03:12:21.504 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T03:12:21.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-17T03:12:21.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-17T03:12:21.573 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T03:12:21.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:12:21.577 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:12:21.635 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T03:12:21.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:12:21.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:12:21.703 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T03:12:21.703 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T03:12:21.703 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T03:12:21.703 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:21.703 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:12:21.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:21.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:21.962 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:21.963 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:12:22.000 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:22.168 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:22.231 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T03:12:22.231 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T03:12:22.231 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/openfiletable}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908408', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgiMkoasa0pQlneuZ/Sw5xRhHoCJ9Kr+6M/qOKNYPuWLcrxar7XcfhWLqmVSB2L+5MTwzXwQYD52jaPueS31M0=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHCb3SuKkLBDR00CgRcfbkFOkf/g8wr4CIZ9QxBPsxer+WaDVkFHEtLHkoRRmns+OjqymzAhBFfK9FRlF6bowv8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_openfiletable']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T03:12:22.232 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:12:22.236 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:12:22.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:12:22.312 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:12:22.368 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:22.368 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:12:22.403 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:12:22.404 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 03:11:46.409507983 +0000 2024-09-17T03:12:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 03:09:39.982940553 +0000 2024-09-17T03:12:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 03:09:39.982940553 +0000 2024-09-17T03:12:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-17 03:09:39.982940553 +0000 2024-09-17T03:12:22.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:12:22.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:12:22.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:12:22.571 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000279385 s, 1.8 MB/s 2024-09-17T03:12:22.574 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:12:22.610 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 03:11:46.410507965 +0000 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 03:09:40.445932265 +0000 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 03:09:40.445932265 +0000 2024-09-17T03:12:22.686 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-17 03:09:40.445932265 +0000 2024-09-17T03:12:22.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:12:22.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:12:22.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:12:22.779 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000294274 s, 1.7 MB/s 2024-09-17T03:12:22.781 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:12:22.817 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 03:11:46.410507965 +0000 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 03:09:40.908923974 +0000 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 03:09:40.908923974 +0000 2024-09-17T03:12:22.893 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-17 03:09:40.908923974 +0000 2024-09-17T03:12:22.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:12:22.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:12:22.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:12:22.986 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000248817 s, 2.1 MB/s 2024-09-17T03:12:22.988 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:12:23.025 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-17T03:12:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-17 03:11:46.411507947 +0000 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-17 03:09:41.385915433 +0000 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-17 03:09:41.385915433 +0000 2024-09-17T03:12:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-17 03:09:41.385915433 +0000 2024-09-17T03:12:23.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:12:23.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:12:23.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:12:23.192 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000317118 s, 1.6 MB/s 2024-09-17T03:12:23.194 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:12:23.230 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:23.231 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:23.231 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:12:23.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:12:23.267 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 03:12:09.624221266 +0000 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 03:09:39.963716457 +0000 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 03:09:39.963716457 +0000 2024-09-17T03:12:23.342 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-17 03:09:39.963716457 +0000 2024-09-17T03:12:23.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:12:23.435 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T03:12:23.435 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T03:12:23.435 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000280641 s, 1.8 MB/s 2024-09-17T03:12:23.438 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:12:23.474 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-17T03:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-17T03:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:23.550 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:23.551 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 03:12:09.625221249 +0000 2024-09-17T03:12:23.551 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 03:09:40.410708970 +0000 2024-09-17T03:12:23.551 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 03:09:40.410708970 +0000 2024-09-17T03:12:23.551 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-17 03:09:40.410708970 +0000 2024-09-17T03:12:23.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:12:23.642 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T03:12:23.642 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T03:12:23.642 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000281365 s, 1.8 MB/s 2024-09-17T03:12:23.645 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:12:23.681 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-17T03:12:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 03:12:09.625221249 +0000 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 03:09:40.873701214 +0000 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 03:09:40.873701214 +0000 2024-09-17T03:12:23.758 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-17 03:09:40.873701214 +0000 2024-09-17T03:12:23.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:12:23.851 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T03:12:23.851 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T03:12:23.851 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000268453 s, 1.9 MB/s 2024-09-17T03:12:23.853 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:12:23.889 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-17 03:12:09.626221232 +0000 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-17 03:09:41.348693258 +0000 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-17 03:09:41.348693258 +0000 2024-09-17T03:12:23.966 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-17 03:09:41.348693258 +0000 2024-09-17T03:12:23.967 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:12:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-17T03:12:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-17T03:12:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000487448 s, 1.1 MB/s 2024-09-17T03:12:24.061 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:12:24.097 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:24.098 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:12:24.098 INFO:tasks.ceph:Generating config... 2024-09-17T03:12:24.099 INFO:tasks.ceph:[client] pid file = 2024-09-17T03:12:24.099 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T03:12:24.099 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T03:12:24.099 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T03:12:24.100 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T03:12:24.100 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T03:12:24.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T03:12:24.256 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T03:12:24.269 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T03:12:24.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:12:24.476 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2024-09-17T03:12:24.477 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T03:12:24.478 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:24.478 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:12:24.512 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:24.694 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:24.694 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:setting min_mon_release = quincy 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:fsid 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2024-09-17T03:12:24.696138+0000 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:created 2024-09-17T03:12:24.696138+0000 2024-09-17T03:12:24.695 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 17 (quincy) 2024-09-17T03:12:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2024-09-17T03:12:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-17T03:12:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-17T03:12:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2024-09-17T03:12:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T03:12:24.703 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:12:24.737 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5a48c3a5-c841-4727-8f9d-e71702e4a9bd... 2024-09-17T03:12:24.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:12:24.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.874 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T03:12:24.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T03:12:24.877 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.878 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:12:24.879 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:12:24.880 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T03:12:24.881 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:12:24.882 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:12:24.883 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T03:12:24.884 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T03:12:24.885 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T03:12:24.886 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:12:24.887 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T03:12:24.888 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T03:12:24.889 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T03:12:24.890 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T03:12:24.891 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T03:12:24.892 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:12:24.893 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.893 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:12:24.893 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-09-17T03:12:24.893 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:12:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:12:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:12:24.905 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T03:12:24.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T03:12:25.071 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T03:12:25.071 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:25.072 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T03:12:25.107 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:25.107 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T03:12:25.184 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:12:25.185 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:25.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:12:25.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:12:25.304 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:25.304 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:25.379 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:12:25.379 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:25.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:12:25.380 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:12:25.458 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:12:25.459 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:25.534 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T03:12:25.534 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T03:12:25.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:12:25.702 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:12:25.716 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:12:25.887 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:12:25.900 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T03:12:25.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:12:26.070 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:12:26.081 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T03:12:26.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:12:26.304 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:12:26.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T03:12:26.372 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:12:26.537 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:12:26.549 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T03:12:26.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:12:26.771 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:12:26.782 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T03:12:26.838 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T03:12:26.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T03:12:26.982 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T03:12:27.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T03:12:27.158 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T03:12:27.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T03:12:27.335 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T03:12:27.369 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T03:12:27.513 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T03:12:27.546 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T03:12:27.547 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:12:27.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T03:12:27.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:27.603 INFO:tasks.ceph:role: osd.0 2024-09-17T03:12:27.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:12:27.603 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:27.666 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:27.666 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:27.666 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:28.073 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-17T03:12:28.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-17T03:12:28.077 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T03:12:28.201 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T03:12:28.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T03:12:28.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:28.322 INFO:tasks.ceph:role: osd.1 2024-09-17T03:12:28.322 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:12:28.322 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:28.386 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:28.745 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-17T03:12:28.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-17T03:12:28.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T03:12:28.840 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T03:12:28.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T03:12:28.958 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:28.958 INFO:tasks.ceph:role: osd.2 2024-09-17T03:12:28.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:12:28.958 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:29.021 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:29.022 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:29.022 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:29.411 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-17T03:12:29.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-17T03:12:29.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T03:12:29.514 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T03:12:29.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T03:12:29.633 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:29.633 INFO:tasks.ceph:role: osd.3 2024-09-17T03:12:29.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:12:29.633 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:29.696 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:29.697 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:29.697 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:29.697 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:29.697 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:30.107 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-17T03:12:30.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-17T03:12:30.110 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T03:12:30.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T03:12:30.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:30.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:30.481+0000 7ff401958640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T03:12:30.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:30.485+0000 7ff401958640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T03:12:30.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:30.485+0000 7ff401958640 -1 bdev(0x5585dc8c1900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:30.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:30.485+0000 7ff401958640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T03:12:33.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T03:12:33.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:33.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:33.772+0000 7f194aa16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T03:12:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:33.773+0000 7f194aa16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T03:12:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:33.773+0000 7f194aa16640 -1 bdev(0x555fb59a1900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:33.774+0000 7f194aa16640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T03:12:36.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T03:12:36.866 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:37.020+0000 7fbf6a624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T03:12:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:37.021+0000 7fbf6a624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T03:12:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:37.021+0000 7fbf6a624640 -1 bdev(0x5609087d7900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:37.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:37.021+0000 7fbf6a624640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T03:12:40.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T03:12:40.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:40.230+0000 7f0949141640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T03:12:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:40.231+0000 7f0949141640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T03:12:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:40.231+0000 7f0949141640 -1 bdev(0x55b154d71900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:12:40.231+0000 7f0949141640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T03:12:43.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T03:12:43.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T03:12:43.385 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:43.385 INFO:tasks.ceph:role: osd.4 2024-09-17T03:12:43.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:12:43.385 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:43.450 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:43.451 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:43.451 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:43.863 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-17T03:12:43.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-17T03:12:43.867 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T03:12:43.987 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T03:12:44.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T03:12:44.110 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:44.110 INFO:tasks.ceph:role: osd.5 2024-09-17T03:12:44.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:12:44.110 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:44.173 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:44.174 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:44.174 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:44.529 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-17T03:12:44.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-17T03:12:44.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T03:12:44.619 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T03:12:44.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T03:12:44.741 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:44.741 INFO:tasks.ceph:role: osd.6 2024-09-17T03:12:44.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:12:44.741 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:12:44.807 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:44.807 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:44.807 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:44.807 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:44.808 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:45.195 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-17T03:12:45.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-17T03:12:45.199 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T03:12:45.301 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T03:12:45.365 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T03:12:45.421 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:12:45.421 INFO:tasks.ceph:role: osd.7 2024-09-17T03:12:45.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:12:45.421 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:12:45.484 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:12:45.485 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:12:45.870 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-17T03:12:45.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-17T03:12:45.874 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T03:12:46.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T03:12:46.074 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:46.246+0000 7f1997c28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T03:12:46.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:46.250+0000 7f1997c28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T03:12:46.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:46.250+0000 7f1997c28640 -1 bdev(0x55eaef0b3900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:46.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:46.250+0000 7f1997c28640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T03:12:49.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T03:12:49.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:49.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:49.742+0000 7f9a3902e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T03:12:49.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:49.743+0000 7f9a3902e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T03:12:49.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:49.743+0000 7f9a3902e640 -1 bdev(0x56117a8ed900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:49.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:49.743+0000 7f9a3902e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T03:12:52.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:52.238 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:53.000 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T03:12:53.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:53.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:53.216+0000 7fdd77b2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T03:12:53.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:53.216+0000 7fdd77b2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T03:12:53.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:53.216+0000 7fdd77b2c640 -1 bdev(0x5638b2287900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:53.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:53.216+0000 7fdd77b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T03:12:56.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T03:12:56.314 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:12:56.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:56.468+0000 7f74b360b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T03:12:56.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:56.469+0000 7f74b360b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T03:12:56.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:56.469+0000 7f74b360b640 -1 bdev(0x55a8898b9900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T03:12:56.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:12:56.469+0000 7f74b360b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T03:12:59.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T03:12:59.767 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T03:12:59.767 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:59.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T03:12:59.830 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:59.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T03:12:59.929 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:12:59.929 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T03:13:00.025 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:00.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T03:13:00.120 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:00.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T03:13:00.216 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:00.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T03:13:00.311 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:00.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T03:13:00.406 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.406 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T03:13:00.468 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.468 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T03:13:00.567 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T03:13:00.663 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.664 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T03:13:00.759 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.760 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T03:13:00.855 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T03:13:00.951 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:00.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T03:13:01.047 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:01.047 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T03:13:01.090 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:01.091 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T03:13:01.178 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:01.178 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T03:13:01.215 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:01.215 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T03:13:01.292 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T03:13:01.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:13:01.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCZ8+hmMSoAKhAAj3XmUlPA9YUsAJZpdvPhjQ== 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmLHZRBBAAGmAg1KpwGuZFL9Quv0LYcA== 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmR5dFEhAA9EF++beLMAzGgqO5hUf1dQ== 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-17T03:13:01.346 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCe8+hmUJHDHBAA6lJxR23sbaAInNreyCzTVw== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCh8+hmNzIiLhAA5aJqW/7GiFmCUqkF0uRMWA== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCl8+hmjy5MARAA4WMewB9KHsaanVAyoxoVlQ== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCo8+hm2n3MDRAAR4L8JPU3RpxMVx8Mj36Gcg== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCZ8+hmqFsANRAADCbozffXEEbgM48FQ9enKQ== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmSI4xIBAAkjTGfzL4FBI0yMQYlitmnw== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmx/wZLhAACTfMeHYPEOv9h22zpC47MQ== 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-17T03:13:01.347 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCu8+hmxBHHDhAAKmnlrNMTbfXPOyZYfJcO5g== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCx8+hm/R5RLBAA3nlpiixH68Vs3ElVKgYisA== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC18+hmCLP0DBAA9BMFyyme36fx/dC2OYI+wg== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQC48+hmaE0GHBAA2ngLlx3/ugZDkkn4KaNWWw== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCb8+hmGy6SCRAAMo8JLvT0xfsNkU2Egh4HIg== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCb8+hmX/ojFBAAiMU/0oZB//5zuXTfSUXNJQ== 2024-09-17T03:13:01.348 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2024-09-17T03:13:01.349 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCb8+hmLQG2HhAAQK4EusAMkZ3Vreg5HWt1tA== 2024-09-17T03:13:01.384 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCZ8+hmMSoAKhAAj3XmUlPA9YUsAJZpdvPhjQ== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCa8+hmLHZRBBAAGmAg1KpwGuZFL9Quv0LYcA== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCa8+hmR5dFEhAA9EF++beLMAzGgqO5hUf1dQ== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCe8+hmUJHDHBAA6lJxR23sbaAInNreyCzTVw== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCh8+hmNzIiLhAA5aJqW/7GiFmCUqkF0uRMWA== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCl8+hmjy5MARAA4WMewB9KHsaanVAyoxoVlQ== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCo8+hm2n3MDRAAR4L8JPU3RpxMVx8Mj36Gcg== 2024-09-17T03:13:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCZ8+hmqFsANRAADCbozffXEEbgM48FQ9enKQ== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCa8+hmSI4xIBAAkjTGfzL4FBI0yMQYlitmnw== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCa8+hmx/wZLhAACTfMeHYPEOv9h22zpC47MQ== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCu8+hmxBHHDhAAKmnlrNMTbfXPOyZYfJcO5g== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCx8+hm/R5RLBAA3nlpiixH68Vs3ElVKgYisA== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC18+hmCLP0DBAA9BMFyyme36fx/dC2OYI+wg== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC48+hmaE0GHBAA2ngLlx3/ugZDkkn4KaNWWw== 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-09-17T03:13:01.386 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ== 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout:[client.2] 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCb8+hmGy6SCRAAMo8JLvT0xfsNkU2Egh4HIg== 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCb8+hmX/ojFBAAiMU/0oZB//5zuXTfSUXNJQ== 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout:[client.3] 2024-09-17T03:13:01.387 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCb8+hmLQG2HhAAQK4EusAMkZ3Vreg5HWt1tA== 2024-09-17T03:13:01.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:13:01.394 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:13:01.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:01.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:01.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:01.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:01.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:01.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.102 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.263 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.266 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:02.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:13:02.599 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:13:02.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:02.767 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:02.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:02.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:13:03.107 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.112 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.276 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.442 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.446 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:13:03.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:03.777 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:03.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:03.947 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:04.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:04.113 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:04.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:04.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:13:04.444 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T03:13:04.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T03:13:04.500 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:13:04.676 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T03:13:04.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T03:13:04.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:13:04.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T03:13:05.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T03:13:05.079 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:13:05.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T03:13:05.309 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:13:05.313 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:13:05.347 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T03:13:05.347 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T03:13:05.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T03:13:05.389 INFO:tasks.ceph.mon.a:Started 2024-09-17T03:13:05.389 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T03:13:05.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T03:13:05.393 INFO:tasks.ceph.mon.b:Started 2024-09-17T03:13:05.393 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T03:13:05.393 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T03:13:05.397 INFO:tasks.ceph.mon.c:Started 2024-09-17T03:13:05.397 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T03:13:05.397 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T03:13:05.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T03:13:05.401 INFO:tasks.ceph.mgr.y:Started 2024-09-17T03:13:05.401 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T03:13:05.401 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T03:13:05.405 INFO:tasks.ceph.mgr.x:Started 2024-09-17T03:13:05.405 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T03:13:05.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T03:13:05.411 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T03:13:05.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T03:13:05.457 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T03:13:05.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T03:13:05.502 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T03:13:05.503 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T03:13:05.548 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T03:13:05.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T03:13:05.595 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T03:13:05.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T03:13:05.644 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T03:13:05.644 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T03:13:05.691 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T03:13:05.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T03:13:05.739 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T03:13:05.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T03:13:05.793 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T03:13:05.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T03:13:05.844 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T03:13:05.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T03:13:05.897 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T03:13:05.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T03:13:05.947 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T03:13:05.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T03:13:05.988 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T03:13:05.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T03:13:06.040 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T03:13:06.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T03:13:06.094 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T03:13:06.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T03:13:06.127 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T03:13:06.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T03:13:06.183 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T03:13:06.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T03:13:06.233 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T03:13:06.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T03:13:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.252+0000 7f3939600640 1 -- 172.21.15.153:0/3167949107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3918003c00 msgr2=0x7f3918004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.252+0000 7f3939600640 1 --2- 172.21.15.153:0/3167949107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3918003c00 0x7f3918004030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3920006fa0 tx=0x7f3918005830 comp rx=0 tx=0).stop 2024-09-17T03:13:06.259 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T03:13:06.259 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T03:13:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.254+0000 7f3939600640 1 -- 172.21.15.153:0/3167949107 shutdown_connections 2024-09-17T03:13:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.254+0000 7f3939600640 1 --2- 172.21.15.153:0/3167949107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3918003c00 0x7f3918004030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.254+0000 7f3939600640 1 -- 172.21.15.153:0/3167949107 >> 172.21.15.153:0/3167949107 conn(0x7f39340d0010 msgr2=0x7f39340d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.254+0000 7f3939600640 1 -- 172.21.15.153:0/3167949107 shutdown_connections 2024-09-17T03:13:06.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.254+0000 7f3939600640 1 -- 172.21.15.153:0/3167949107 wait complete. 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.273+0000 7fec8f200640 1 -- 172.21.15.153:0/1627120746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec88153570 msgr2=0x7fec881f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.273+0000 7fec8f200640 1 --2- 172.21.15.153:0/1627120746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec88153570 0x7fec881f7ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec84009d90 tx=0x7fec84004a40 comp rx=0 tx=0).stop 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 -- 172.21.15.153:0/1627120746 shutdown_connections 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 --2- 172.21.15.153:0/1627120746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec88153570 0x7fec881f7ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 --2- 172.21.15.153:0/1627120746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec8815c440 0x7fec881eafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 --2- 172.21.15.153:0/1627120746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec88152300 0x7fec880cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 -- 172.21.15.153:0/1627120746 >> 172.21.15.153:0/1627120746 conn(0x7fec880cfec0 msgr2=0x7fec881518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 -- 172.21.15.153:0/1627120746 shutdown_connections 2024-09-17T03:13:06.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.275+0000 7fec8f200640 1 -- 172.21.15.153:0/1627120746 wait complete. 2024-09-17T03:13:06.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.270+0000 7f3939600640 1 Processor -- start 2024-09-17T03:13:06.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.270+0000 7f3939600640 1 -- start start 2024-09-17T03:13:06.288 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T03:13:06.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.277+0000 7f3939600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.277+0000 7f3939600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3934154500 0x7f39341f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.277+0000 7f3939600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39341f4400 0x7f39341f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.278+0000 7f3939600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f393415ec50 con 0x7f3918003c00 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.278+0000 7f3939600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39340ad070 con 0x7f39341f4400 2024-09-17T03:13:06.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.278+0000 7f3939600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f393415edd0 con 0x7f3934154500 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.278+0000 7f3932000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.279+0000 7f3932000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57506/0 (socket says 172.21.15.153:57506) 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.279+0000 7f3932000640 1 -- 172.21.15.153:0/1863306115 learned_addr learned my addr 172.21.15.153:0/1863306115 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.284+0000 7f3932000640 1 -- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3934154500 msgr2=0x7f39341f3ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.284+0000 7f3932000640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3934154500 0x7f39341f3ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.284+0000 7f3932000640 1 -- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39341f4400 msgr2=0x7f39341f4810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.284+0000 7f3932000640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39341f4400 0x7f39341f4810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.284+0000 7f3932000640 1 -- 172.21.15.153:0/1863306115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39340cd210 con 0x7f3918003c00 2024-09-17T03:13:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.285+0000 7f3932000640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3920006b80 tx=0x7f3920004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.292+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920031070 con 0x7f3918003c00 2024-09-17T03:13:06.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.292+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f3920004dc0 con 0x7f3918003c00 2024-09-17T03:13:06.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.292+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39340ccc50 con 0x7f3918003c00 2024-09-17T03:13:06.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.293+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39340ca8b0 con 0x7f3918003c00 2024-09-17T03:13:06.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.293+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392002c6b0 con 0x7f3918003c00 2024-09-17T03:13:06.305 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T03:13:06.306 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T03:13:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.298+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3920040070 con 0x7f3918003c00 2024-09-17T03:13:06.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.298+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f392002d8f0 con 0x7f3918003c00 2024-09-17T03:13:06.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.310+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c005080 con 0x7f3918003c00 2024-09-17T03:13:06.318 DEBUG:tasks.ceph:set 22 configs 2024-09-17T03:13:06.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.319 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.316+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f0220000ea0 con 0x7f02480ca640 2024-09-17T03:13:06.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.316+0000 7f382aa00640 1 -- 172.21.15.153:0/860502562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c00a2d0 msgr2=0x7f381c00a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.316+0000 7f382aa00640 1 --2- 172.21.15.153:0/860502562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c00a2d0 0x7f381c00a6e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f381c00bea0 tx=0x7f381802a530 comp rx=0 tx=0).stop 2024-09-17T03:13:06.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.327+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3920006320 con 0x7f3918003c00 2024-09-17T03:13:06.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 -- 172.21.15.153:0/860502562 shutdown_connections 2024-09-17T03:13:06.343 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 --2- 172.21.15.153:0/860502562 >> v2:172.21.15.153:3300/0 conn(0x7f381c0366f0 0x7f381c036b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 --2- 172.21.15.153:0/860502562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c00a2d0 0x7f381c00a6e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 -- 172.21.15.153:0/860502562 >> 172.21.15.153:0/860502562 conn(0x7f381c051420 msgr2=0x7f381c051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 -- 172.21.15.153:0/860502562 shutdown_connections 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.326+0000 7f382aa00640 1 -- 172.21.15.153:0/860502562 wait complete. 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.334+0000 7f382aa00640 1 Processor -- start 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.334+0000 7f382aa00640 1 -- start start 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.341+0000 7f382aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f381c00a2d0 0x7f381c04e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.342+0000 7f382aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 0x7f381c0d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.348+0000 7f382aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.348+0000 7f382aa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0e1540 con 0x7f381c01c950 2024-09-17T03:13:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.348+0000 7f382aa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0e13c0 con 0x7f381c00a2d0 2024-09-17T03:13:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.348+0000 7f382aa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f381c009e80 con 0x7f381c0366f0 2024-09-17T03:13:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.349+0000 7f382a000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.351+0000 7f023ea00640 1 -- 172.21.15.153:0/842527993 <== mon.2 v2:172.21.15.164:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v5)=0 v5) ==== 108+0+0 (secure 0 0 0) 0x7f02400153e0 con 0x7f02480ca640 2024-09-17T03:13:06.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.353+0000 7f382a000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56710/0 (socket says 172.21.15.153:56710) 2024-09-17T03:13:06.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.353+0000 7f382a000640 1 -- 172.21.15.153:0/2035661447 learned_addr learned my addr 172.21.15.153:0/2035661447 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02480ca640 msgr2=0x7f02480caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f0233e00640 1 --2- 172.21.15.153:0/842527993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02480ca640 0x7f02480caa50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f024000a980 tx=0x7f024000ae40 comp rx=0 tx=0).stop 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 shutdown_connections 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f0233e00640 1 --2- 172.21.15.153:0/842527993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02480ca640 0x7f02480caa50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f0233e00640 1 --2- 172.21.15.153:0/842527993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0248150f60 0x7f0248150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.358+0000 7f0233e00640 1 --2- 172.21.15.153:0/842527993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f024815e840 0x7f02480b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.358+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 >> 172.21.15.153:0/842527993 conn(0x7f02480d0010 msgr2=0x7f0248070300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.358+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 shutdown_connections 2024-09-17T03:13:06.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.358+0000 7f0233e00640 1 -- 172.21.15.153:0/842527993 wait complete. 2024-09-17T03:13:06.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.355+0000 7f3828c00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 0x7f381c0d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.357+0000 7f3829600640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f381c00a2d0 0x7f381c04e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.361+0000 7f382a000640 1 -- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f381c00a2d0 msgr2=0x7f381c04e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.361+0000 7f382a000640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f381c00a2d0 0x7f381c04e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.361+0000 7f382a000640 1 -- 172.21.15.153:0/2035661447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 msgr2=0x7f381c0d7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.384+0000 7f382a000640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 0x7f381c0d7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.384+0000 7f382a000640 1 -- 172.21.15.153:0/2035661447 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0d8420 con 0x7f381c0366f0 2024-09-17T03:13:06.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.384+0000 7f3828c00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 0x7f381c0d7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:06.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.385+0000 7f382a000640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f382406c0e0 tx=0x7f382406a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.389+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240753c0 con 0x7f381c0366f0 2024-09-17T03:13:06.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.389+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f3824076180 con 0x7f381c0366f0 2024-09-17T03:13:06.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.390+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c04d240 con 0x7f381c0366f0 2024-09-17T03:13:06.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.390+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c04d800 con 0x7f381c0366f0 2024-09-17T03:13:06.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.392+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824076590 con 0x7f381c0366f0 2024-09-17T03:13:06.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.393+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c00a6e0 con 0x7f381c0366f0 2024-09-17T03:13:06.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.403+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f2330000e30 con 0x7f235c0b8070 2024-09-17T03:13:06.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.412+0000 7f3df3400640 1 -- 172.21.15.153:0/1855816897 <== mon.2 v2:172.21.15.164:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f3dec0127e0 con 0x7f3dfc0aa860 2024-09-17T03:13:06.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.413+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3824082400 con 0x7f381c0366f0 2024-09-17T03:13:06.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.413+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f382408b730 con 0x7f381c0366f0 2024-09-17T03:13:06.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.413+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3824090020 con 0x7f381c0366f0 2024-09-17T03:13:06.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.413+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f382408bb80 con 0x7f381c0366f0 2024-09-17T03:13:06.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.415+0000 7f2358c00640 1 -- 172.21.15.153:0/2546137478 <== mon.1 v2:172.21.15.164:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f23540051d0 con 0x7f235c0b8070 2024-09-17T03:13:06.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.415+0000 7f2358c00640 1 -- 172.21.15.153:0/2546137478 <== mon.1 v2:172.21.15.164:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f235c0b8480 con 0x7f235c0b8070 2024-09-17T03:13:06.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.419+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f392002db40 con 0x7f3918003c00 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f235c0b8070 msgr2=0x7f235c1f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 --2- 172.21.15.153:0/2546137478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f235c0b8070 0x7f235c1f8400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f235c0d0b40 tx=0x7f235400ecc0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 shutdown_connections 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 --2- 172.21.15.153:0/2546137478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f235c0b8070 0x7f235c1f8400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 --2- 172.21.15.153:0/2546137478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f235c0ca4f0 0x7f235c0b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 --2- 172.21.15.153:0/2546137478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f235c0ca0e0 0x7f235c1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.423+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 >> 172.21.15.153:0/2546137478 conn(0x7f235c0d1960 msgr2=0x7f235c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.424+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 shutdown_connections 2024-09-17T03:13:06.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.424+0000 7f2362400640 1 -- 172.21.15.153:0/2546137478 wait complete. 2024-09-17T03:13:06.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.430+0000 7ff274000640 1 -- 172.21.15.153:0/2699587373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff254003ac0 msgr2=0x7ff254003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.430+0000 7ff274000640 1 --2- 172.21.15.153:0/2699587373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff254003ac0 0x7ff254003f30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c3c0 tx=0x7ff254005830 comp rx=0 tx=0).stop 2024-09-17T03:13:06.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.436+0000 7ff272a00640 1 -- 172.21.15.153:0/2699587373 reap_dead start 2024-09-17T03:13:06.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.441+0000 7ff274000640 1 -- 172.21.15.153:0/2699587373 shutdown_connections 2024-09-17T03:13:06.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.441+0000 7ff274000640 1 -- 172.21.15.153:0/2699587373 >> 172.21.15.153:0/2699587373 conn(0x7ff26c0d0010 msgr2=0x7ff26c0d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.441+0000 7ff274000640 1 -- 172.21.15.153:0/2699587373 shutdown_connections 2024-09-17T03:13:06.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.441+0000 7ff274000640 1 -- 172.21.15.153:0/2699587373 wait complete. 2024-09-17T03:13:06.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.453+0000 7ff274000640 1 Processor -- start 2024-09-17T03:13:06.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.453+0000 7ff274000640 1 -- start start 2024-09-17T03:13:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.460+0000 7ff274000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 0x7ff26c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.460+0000 7ff274000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 0x7ff26c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.461+0000 7ff271600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 0x7ff26c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.461+0000 7ff271600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 0x7ff26c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56724/0 (socket says 172.21.15.153:56724) 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.465+0000 7ff274000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 0x7ff26c073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.465+0000 7ff271600640 1 -- 172.21.15.153:0/1459479684 learned_addr learned my addr 172.21.15.153:0/1459479684 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.465+0000 7ff270c00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 0x7ff26c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.466+0000 7ff274000640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0acfe0 con 0x7ff26c15c290 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.466+0000 7ff274000640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c0ace60 con 0x7ff26c1514c0 2024-09-17T03:13:06.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.466+0000 7ff274000640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c06ece0 con 0x7ff26c1f53e0 2024-09-17T03:13:06.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.467+0000 7ff270c00640 1 -- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 msgr2=0x7ff26c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.467+0000 7ff270c00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 0x7ff26c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.467+0000 7ff270c00640 1 -- 172.21.15.153:0/1459479684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 msgr2=0x7ff26c073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.467+0000 7ff272a00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 0x7ff26c073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.471+0000 7ff270c00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 0x7ff26c073c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.471+0000 7ff270c00640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c15c6a0 con 0x7ff26c1514c0 2024-09-17T03:13:06.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.471+0000 7ff272a00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 0x7ff26c073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:06.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.473+0000 7ff270c00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 0x7ff26c15bd50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0c3620 tx=0x7ff25800b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.473+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258015020 con 0x7ff26c1514c0 2024-09-17T03:13:06.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.474+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff258011900 con 0x7ff26c1514c0 2024-09-17T03:13:06.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.474+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258011d30 con 0x7ff26c1514c0 2024-09-17T03:13:06.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.480+0000 7ff274000640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c0b3510 con 0x7ff26c1514c0 2024-09-17T03:13:06.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.480+0000 7ff274000640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c0b51c0 con 0x7ff26c1514c0 2024-09-17T03:13:06.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.491+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff240005290 con 0x7ff26c1514c0 2024-09-17T03:13:06.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.499+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff258018020 con 0x7ff26c1514c0 2024-09-17T03:13:06.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.499+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff258019850 con 0x7ff26c1514c0 2024-09-17T03:13:06.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.519+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff25801f020 con 0x7ff26c1514c0 2024-09-17T03:13:06.530 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.527+0000 7f3dfbe00640 1 -- 172.21.15.153:0/1855816897 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f3dd0005310 con 0x7f3dfc0aa860 2024-09-17T03:13:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.553+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f392002dd10 con 0x7f3918003c00 2024-09-17T03:13:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.557+0000 7f3df3400640 1 -- 172.21.15.153:0/1855816897 <== mon.2 v2:172.21.15.164:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dec02c020 con 0x7f3dfc0aa860 2024-09-17T03:13:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.557+0000 7f3df3400640 1 -- 172.21.15.153:0/1855816897 <== mon.2 v2:172.21.15.164:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7f3dec012a70 con 0x7f3dfc0aa860 2024-09-17T03:13:06.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.559+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2580193b0 con 0x7ff26c1514c0 2024-09-17T03:13:06.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 -- 172.21.15.153:0/1855816897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dfc0aa860 msgr2=0x7f3dfc1f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 --2- 172.21.15.153:0/1855816897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dfc0aa860 0x7f3dfc1f3e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0ae200 tx=0x7f3dec009f90 comp rx=0 tx=0).stop 2024-09-17T03:13:06.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 -- 172.21.15.153:0/1855816897 shutdown_connections 2024-09-17T03:13:06.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 --2- 172.21.15.153:0/1855816897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3dfc0aa860 0x7f3dfc1f3e30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.565+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f382408be10 con 0x7f381c0366f0 2024-09-17T03:13:06.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 --2- 172.21.15.153:0/1855816897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3dfc150b30 0x7f3dfc1f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 --2- 172.21.15.153:0/1855816897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3de00039b0 0x7f3dfc1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.564+0000 7f3df0c00640 1 -- 172.21.15.153:0/1855816897 >> 172.21.15.153:0/1855816897 conn(0x7f3dfc0cfec0 msgr2=0x7f3dfc0b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.565+0000 7f3df0c00640 1 -- 172.21.15.153:0/1855816897 shutdown_connections 2024-09-17T03:13:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.565+0000 7f3df0c00640 1 -- 172.21.15.153:0/1855816897 wait complete. 2024-09-17T03:13:06.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.580+0000 7f7062200640 1 -- 172.21.15.153:0/2161925023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054054790 msgr2=0x7f7054054ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.584+0000 7f7062200640 1 --2- 172.21.15.153:0/2161925023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054054790 0x7f7054054ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7050005fd0 tx=0x7f705002a520 comp rx=0 tx=0).stop 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.584+0000 7f7062200640 1 -- 172.21.15.153:0/2161925023 shutdown_connections 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.584+0000 7f7062200640 1 --2- 172.21.15.153:0/2161925023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054054790 0x7f7054054ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.584+0000 7f7062200640 1 --2- 172.21.15.153:0/2161925023 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054035e50 0x7f70540e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.584+0000 7f7062200640 1 -- 172.21.15.153:0/2161925023 >> 172.21.15.153:0/2161925023 conn(0x7f705401db70 msgr2=0x7f7054039830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.585+0000 7f7062200640 1 -- 172.21.15.153:0/2161925023 shutdown_connections 2024-09-17T03:13:06.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.585+0000 7f7062200640 1 -- 172.21.15.153:0/2161925023 wait complete. 2024-09-17T03:13:06.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.601+0000 7f7062200640 1 Processor -- start 2024-09-17T03:13:06.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.601+0000 7f7062200640 1 -- start start 2024-09-17T03:13:06.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.615+0000 7f7062200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.615+0000 7f7062200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 0x7f7054004c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.616+0000 7f705b400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.620+0000 7f7062200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 0x7f70540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.620+0000 7f7062200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7054055260 con 0x7f7054054790 2024-09-17T03:13:06.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.620+0000 7f7062200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f70540550e0 con 0x7f7054035e50 2024-09-17T03:13:06.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.620+0000 7f7062200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f70540553e0 con 0x7f7054007440 2024-09-17T03:13:06.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.628+0000 7f705b400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56732/0 (socket says 172.21.15.153:56732) 2024-09-17T03:13:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.628+0000 7f705aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 0x7f7054004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.628+0000 7f705aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 0x7f7054004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33456/0 (socket says 172.21.15.153:33456) 2024-09-17T03:13:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.628+0000 7f705aa00640 1 -- 172.21.15.153:0/20114201 learned_addr learned my addr 172.21.15.153:0/20114201 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.632+0000 7f7060c00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 0x7f70540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f705b400640 1 -- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 msgr2=0x7f7054004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f705b400640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 0x7f7054004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f705b400640 1 -- 172.21.15.153:0/20114201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 msgr2=0x7f70540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f705b400640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 0x7f70540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f705b400640 1 -- 172.21.15.153:0/20114201 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7054005a30 con 0x7f7054007440 2024-09-17T03:13:06.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.633+0000 7f7060c00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 0x7f70540051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:06.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.637+0000 7f705b400640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f705c06bcf0 tx=0x7f705c0519a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.639+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c075a80 con 0x7f7054007440 2024-09-17T03:13:06.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.639+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f705c076180 con 0x7f7054007440 2024-09-17T03:13:06.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.639+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c076650 con 0x7f7054007440 2024-09-17T03:13:06.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.640+0000 7f7062200640 1 -- 172.21.15.153:0/20114201 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70540c6640 con 0x7f7054007440 2024-09-17T03:13:06.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.640+0000 7f7062200640 1 -- 172.21.15.153:0/20114201 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70540c6c00 con 0x7f7054007440 2024-09-17T03:13:06.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.652+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f705c093400 con 0x7f7054007440 2024-09-17T03:13:06.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.652+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f705c09d730 con 0x7f7054007440 2024-09-17T03:13:06.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.652+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7054052780 con 0x7f7054007440 2024-09-17T03:13:06.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.655+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f705c08f030 con 0x7f7054007440 2024-09-17T03:13:06.671 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.671 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.681+0000 7f4930a00640 1 -- 172.21.15.153:0/2516330535 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c006c90 con 0x7f4914004800 2024-09-17T03:13:06.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.685+0000 7f4934800640 1 -- 172.21.15.153:0/2516330535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4914004800 msgr2=0x7f4914004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.685+0000 7f4934800640 1 --2- 172.21.15.153:0/2516330535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4914004800 0x7f4914004c10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f492800ef10 tx=0x7f4914005830 comp rx=0 tx=0).stop 2024-09-17T03:13:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.689+0000 7f4934800640 1 -- 172.21.15.153:0/2516330535 shutdown_connections 2024-09-17T03:13:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.689+0000 7f4934800640 1 --2- 172.21.15.153:0/2516330535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4914004800 0x7f4914004c10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.689+0000 7f4934800640 1 -- 172.21.15.153:0/2516330535 >> 172.21.15.153:0/2516330535 conn(0x7f492800e220 msgr2=0x7f492800e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.689+0000 7f4934800640 1 -- 172.21.15.153:0/2516330535 shutdown_connections 2024-09-17T03:13:06.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.689+0000 7f4934800640 1 -- 172.21.15.153:0/2516330535 wait complete. 2024-09-17T03:13:06.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.707+0000 7f4934800640 1 Processor -- start 2024-09-17T03:13:06.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.708+0000 7f4934800640 1 -- start start 2024-09-17T03:13:06.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.711+0000 7f4934800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 0x7f492800c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.712+0000 7f4934800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.712+0000 7f4934800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 0x7f4928181e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.712+0000 7f4934800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4928053a90 con 0x7f4914004800 2024-09-17T03:13:06.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.712+0000 7f4934800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4928053910 con 0x7f492800bff0 2024-09-17T03:13:06.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.712+0000 7f4934800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4928053c10 con 0x7f49281819f0 2024-09-17T03:13:06.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.714+0000 7f4931e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 0x7f492800c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.714+0000 7f4931400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.714+0000 7f4931400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33458/0 (socket says 172.21.15.153:33458) 2024-09-17T03:13:06.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.714+0000 7f4931400640 1 -- 172.21.15.153:0/818318767 learned_addr learned my addr 172.21.15.153:0/818318767 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.713+0000 7f4932800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 0x7f4928181e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.716+0000 7f4931400640 1 -- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 msgr2=0x7f4928181e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.716+0000 7f4931400640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 0x7f4928181e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.716+0000 7f4931400640 1 -- 172.21.15.153:0/818318767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 msgr2=0x7f492800c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.716+0000 7f4931400640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 0x7f492800c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.716+0000 7f4931400640 1 -- 172.21.15.153:0/818318767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4928182860 con 0x7f492800bff0 2024-09-17T03:13:06.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.717+0000 7f4931e00640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 0x7f492800c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:06.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.717+0000 7f4932800640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 0x7f4928181e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:06.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.719+0000 7f4931400640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f491c030040 tx=0x7f491c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.719+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c031040 con 0x7f492800bff0 2024-09-17T03:13:06.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.719+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f491c006630 con 0x7f492800bff0 2024-09-17T03:13:06.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.719+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c006c90 con 0x7f492800bff0 2024-09-17T03:13:06.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.723+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4928182340 con 0x7f492800bff0 2024-09-17T03:13:06.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.723+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492800b230 con 0x7f492800bff0 2024-09-17T03:13:06.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.725+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492800d710 con 0x7f492800bff0 2024-09-17T03:13:06.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.725+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f491c0387d0 con 0x7f492800bff0 2024-09-17T03:13:06.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.725+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f491c037460 con 0x7f492800bff0 2024-09-17T03:13:06.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.729+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f491c047030 con 0x7f492800bff0 2024-09-17T03:13:06.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.745+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f39080052f0 con 0x7f3918003c00 2024-09-17T03:13:06.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.791+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f37f80052f0 con 0x7f381c0366f0 2024-09-17T03:13:06.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.795+0000 7f1bb3000640 1 -- 172.21.15.153:0/2477663238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac070bb0 msgr2=0x7f1bac0cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.798+0000 7f392aa00640 1 -- 172.21.15.153:0/1863306115 <== mon.0 v2:172.21.15.153:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f392002c850 con 0x7f3918003c00 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 --2- 172.21.15.153:0/2477663238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac070bb0 0x7f1bac0cddc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400afd0 tx=0x7f1ba402b530 comp rx=0 tx=0).stop 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 -- 172.21.15.153:0/2477663238 shutdown_connections 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 --2- 172.21.15.153:0/2477663238 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac070bb0 0x7f1bac0cddc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 --2- 172.21.15.153:0/2477663238 >> v2:172.21.15.164:3300/0 conn(0x7f1bac074820 0x7f1bac0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 -- 172.21.15.153:0/2477663238 >> 172.21.15.153:0/2477663238 conn(0x7f1bac0cfec0 msgr2=0x7f1bac0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 -- 172.21.15.153:0/2477663238 shutdown_connections 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f1bb3000640 1 -- 172.21.15.153:0/2477663238 wait complete. 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 msgr2=0x7f39340cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.799+0000 7f3939600640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3920006b80 tx=0x7f3920004910 comp rx=0 tx=0).stop 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 shutdown_connections 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39341f4400 0x7f39341f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3934154500 0x7f39341f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 --2- 172.21.15.153:0/1863306115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3918003c00 0x7f39340cc2d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 >> 172.21.15.153:0/1863306115 conn(0x7f39340d0010 msgr2=0x7f393415c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 shutdown_connections 2024-09-17T03:13:06.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.803+0000 7f3939600640 1 -- 172.21.15.153:0/1863306115 wait complete. 2024-09-17T03:13:06.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.806+0000 7f3821600640 1 -- 172.21.15.153:0/2035661447 <== mon.2 v2:172.21.15.164:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f382407e030 con 0x7f381c0366f0 2024-09-17T03:13:06.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 msgr2=0x7f381c01eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f382406c0e0 tx=0x7f382406a0e0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 shutdown_connections 2024-09-17T03:13:06.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f381c0366f0 0x7f381c01eb50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f381c01c950 0x7f381c0d7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 --2- 172.21.15.153:0/2035661447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f381c00a2d0 0x7f381c04e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.809+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 >> 172.21.15.153:0/2035661447 conn(0x7f381c051420 msgr2=0x7f381c0e08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.812+0000 7f1f11600640 1 -- 172.21.15.153:0/748250285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 msgr2=0x7f1f0c15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.810+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 shutdown_connections 2024-09-17T03:13:06.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.813+0000 7f1f11600640 1 --2- 172.21.15.153:0/748250285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c15e520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005fd0 tx=0x7f1f0402a8d0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.813+0000 7f382aa00640 1 -- 172.21.15.153:0/2035661447 wait complete. 2024-09-17T03:13:06.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.815+0000 7f1f11600640 1 -- 172.21.15.153:0/748250285 shutdown_connections 2024-09-17T03:13:06.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.815+0000 7f1f11600640 1 --2- 172.21.15.153:0/748250285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c15e520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.815+0000 7f1f11600640 1 -- 172.21.15.153:0/748250285 >> 172.21.15.153:0/748250285 conn(0x7f1f0c06cde0 msgr2=0x7f1f0c06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.815+0000 7f1f11600640 1 -- 172.21.15.153:0/748250285 shutdown_connections 2024-09-17T03:13:06.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.818+0000 7f1f11600640 1 -- 172.21.15.153:0/748250285 wait complete. 2024-09-17T03:13:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.822+0000 7f1bb3000640 1 Processor -- start 2024-09-17T03:13:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.823+0000 7f1bb3000640 1 -- start start 2024-09-17T03:13:06.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.825+0000 7f619c600640 1 -- 172.21.15.153:0/408622808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f617c0053f0 msgr2=0x7f617c00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.825+0000 7f619c600640 1 --2- 172.21.15.153:0/408622808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f617c0053f0 0x7f617c00ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f618c00c640 tx=0x7f617c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.825+0000 7f619a600640 1 -- 172.21.15.153:0/408622808 reap_dead start 2024-09-17T03:13:06.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.829+0000 7f619c600640 1 -- 172.21.15.153:0/408622808 shutdown_connections 2024-09-17T03:13:06.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.829+0000 7f619c600640 1 -- 172.21.15.153:0/408622808 >> 172.21.15.153:0/408622808 conn(0x7f61940b1b90 msgr2=0x7f61940b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.829+0000 7f619c600640 1 -- 172.21.15.153:0/408622808 shutdown_connections 2024-09-17T03:13:06.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.829+0000 7f619c600640 1 -- 172.21.15.153:0/408622808 wait complete. 2024-09-17T03:13:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.833+0000 7f1f11600640 1 Processor -- start 2024-09-17T03:13:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.834+0000 7f1f11600640 1 -- start start 2024-09-17T03:13:06.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.841+0000 7f1f11600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.842+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff240005850 con 0x7ff26c1514c0 2024-09-17T03:13:06.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.845+0000 7f1bb3000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac074820 0x7f1bac202bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.847+0000 7f619c600640 1 Processor -- start 2024-09-17T03:13:06.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.842+0000 7f1f11600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 0x7f1f0c143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f0a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 0x7f1f0c143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f0a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 0x7f1f0c143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33492/0 (socket says 172.21.15.153:33492) 2024-09-17T03:13:06.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f11600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 0x7f1f0c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f11600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0af350 con 0x7f1f0c06edf0 2024-09-17T03:13:06.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f0a000640 1 -- 172.21.15.153:0/2461700249 learned_addr learned my addr 172.21.15.153:0/2461700249 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f11600640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0af1d0 con 0x7f1f0c073ba0 2024-09-17T03:13:06.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f1f11600640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c0af4d0 con 0x7f1f0c152dd0 2024-09-17T03:13:06.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.848+0000 7f619c600640 1 -- start start 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 0x7f1f0c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0aa00640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 -- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 msgr2=0x7f1f0c143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 0x7f1f0c143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 -- 172.21.15.153:0/2461700249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 msgr2=0x7f1f0c143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.849+0000 7f1f0b400640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c1548b0 con 0x7f1f0c152dd0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.851+0000 7f1f0b400640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 0x7f1f0c155950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c310 tx=0x7f1efc00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.851+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc015d70 con 0x7f1f0c152dd0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.851+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1efc0050d0 con 0x7f1f0c152dd0 2024-09-17T03:13:06.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.851+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0035f0 con 0x7f1f0c152dd0 2024-09-17T03:13:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.859+0000 7f619c600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.860+0000 7f6199c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.860+0000 7f6199c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57594/0 (socket says 172.21.15.153:57594) 2024-09-17T03:13:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.861+0000 7f6199c00640 1 -- 172.21.15.153:0/345743517 learned_addr learned my addr 172.21.15.153:0/345743517 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.861+0000 7f619c600640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 0x7f619420a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.861+0000 7f619c600640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 0x7f619406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.861+0000 7f6199200640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 0x7f619420a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.862+0000 7f619a600640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 0x7f619406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.862+0000 7f619c600640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f619406df70 con 0x7f6194169df0 2024-09-17T03:13:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.862+0000 7f619c600640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f619406ddf0 con 0x7f619406f820 2024-09-17T03:13:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.862+0000 7f619c600640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f61940cc4c0 con 0x7f6194209ed0 2024-09-17T03:13:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.867+0000 7f1f11600640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c154b90 con 0x7f1f0c152dd0 2024-09-17T03:13:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.867+0000 7f1f11600640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c155150 con 0x7f1f0c152dd0 2024-09-17T03:13:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199c00640 1 -- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 msgr2=0x7f619420a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199c00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 0x7f619420a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199c00640 1 -- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 msgr2=0x7f619406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199c00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 0x7f619406fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199c00640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6194070170 con 0x7f6194169df0 2024-09-17T03:13:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f6199200640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 0x7f619420a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.869+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee0005290 con 0x7f1f0c152dd0 2024-09-17T03:13:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.868+0000 7f619a600640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 0x7f619406fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.871+0000 7f6199c00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f618800b780 tx=0x7f618800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.872+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188019070 con 0x7f6194169df0 2024-09-17T03:13:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.874+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f618800c830 con 0x7f6194169df0 2024-09-17T03:13:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.874+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618800cc80 con 0x7f6194169df0 2024-09-17T03:13:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.876+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1efc003b20 con 0x7f1f0c152dd0 2024-09-17T03:13:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.876+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1efc01d730 con 0x7f1f0c152dd0 2024-09-17T03:13:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.875+0000 7ff269600640 1 -- 172.21.15.153:0/1459479684 <== mon.1 v2:172.21.15.164:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7ff26c15c6a0 con 0x7ff26c1514c0 2024-09-17T03:13:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.874+0000 7f619c600640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6194207560 con 0x7f6194169df0 2024-09-17T03:13:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.881+0000 7f619c600640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6194206a80 con 0x7f6194169df0 2024-09-17T03:13:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 msgr2=0x7ff26c15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7ff25ea00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 0x7ff26c15bd50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0c3620 tx=0x7ff25800b820 comp rx=0 tx=0).stop 2024-09-17T03:13:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1efc01d9d0 con 0x7f1f0c152dd0 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.845+0000 7f1bb3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.875+0000 7f1bb3000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bac1403c0 0x7f1bac0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.875+0000 7f1bb3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac070260 con 0x7f1bac15ed20 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.875+0000 7f1bb3000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac073420 con 0x7f1bac1403c0 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.875+0000 7f1bb3000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1bac0ce300 con 0x7f1bac074820 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.881+0000 7f1bb1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.881+0000 7f1bb1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57606/0 (socket says 172.21.15.153:57606) 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.881+0000 7f1bb1200640 1 -- 172.21.15.153:0/370474063 learned_addr learned my addr 172.21.15.153:0/370474063 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1200640 1 -- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac074820 msgr2=0x7f1bac202bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1c00640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac074820 0x7f1bac202bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1200640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac074820 0x7f1bac202bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1200640 1 -- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bac1403c0 msgr2=0x7f1bac0ad2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:13:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1200640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bac1403c0 0x7f1bac0ad2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.884+0000 7f1bb1200640 1 -- 172.21.15.153:0/370474063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac13e0e0 con 0x7f1bac15ed20 2024-09-17T03:13:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.888+0000 7f1bb1200640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800b3f0 tx=0x7f1b9800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 shutdown_connections 2024-09-17T03:13:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7ff25ea00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff26c15c290 0x7ff26c073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7ff25ea00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff26c1514c0 0x7ff26c15bd50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7ff25ea00640 1 --2- 172.21.15.153:0/1459479684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff26c1f53e0 0x7ff26c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 >> 172.21.15.153:0/1459479684 conn(0x7ff26c0d0010 msgr2=0x7ff26c15d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.889+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98015020 con 0x7f1bac15ed20 2024-09-17T03:13:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b98011920 con 0x7f1bac15ed20 2024-09-17T03:13:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011db0 con 0x7f1bac15ed20 2024-09-17T03:13:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.893+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 shutdown_connections 2024-09-17T03:13:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.893+0000 7ff25ea00640 1 -- 172.21.15.153:0/1459479684 wait complete. 2024-09-17T03:13:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.892+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac13e3c0 con 0x7f1bac15ed20 2024-09-17T03:13:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.893+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac13e980 con 0x7f1bac15ed20 2024-09-17T03:13:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.893+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6168005290 con 0x7f6194169df0 2024-09-17T03:13:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.893+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f618801c070 con 0x7f6194169df0 2024-09-17T03:13:06.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.900+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f618801d990 con 0x7f6194169df0 2024-09-17T03:13:06.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.903+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6194070170 con 0x7f6194169df0 2024-09-17T03:13:06.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.906+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f7054008cf0 con 0x7f7054007440 2024-09-17T03:13:06.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.913+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b88005290 con 0x7f1bac15ed20 2024-09-17T03:13:06.914 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.914 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.917+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b98018020 con 0x7f1bac15ed20 2024-09-17T03:13:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.917+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1b98019a10 con 0x7f1bac15ed20 2024-09-17T03:13:06.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.924+0000 7f704f400640 1 -- 172.21.15.153:0/20114201 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f705c08f030 con 0x7f7054007440 2024-09-17T03:13:06.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.929+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b9801f020 con 0x7f1bac15ed20 2024-09-17T03:13:06.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.929+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 msgr2=0x7f7054032b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.929+0000 7f704cc00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f705c06bcf0 tx=0x7f705c0519a0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.931+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 shutdown_connections 2024-09-17T03:13:06.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.931+0000 7f704cc00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7054054790 0x7f70540051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.931+0000 7f704cc00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7054035e50 0x7f7054004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.931+0000 7f704cc00640 1 --2- 172.21.15.153:0/20114201 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7054007440 0x7f7054032b30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.931+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 >> 172.21.15.153:0/20114201 conn(0x7f705401db70 msgr2=0x7f70540e5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.932+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 shutdown_connections 2024-09-17T03:13:06.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.932+0000 7f704cc00640 1 -- 172.21.15.153:0/20114201 wait complete. 2024-09-17T03:13:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.970+0000 7f02e3800640 1 -- 172.21.15.153:0/52874264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc073000 msgr2=0x7f02dc0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.970+0000 7f02e3800640 1 --2- 172.21.15.153:0/52874264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc073000 0x7f02dc0cc160 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0cc0c0 tx=0x7f02c802a610 comp rx=0 tx=0).stop 2024-09-17T03:13:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.973+0000 7f02e3800640 1 -- 172.21.15.153:0/52874264 shutdown_connections 2024-09-17T03:13:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.973+0000 7f02e3800640 1 --2- 172.21.15.153:0/52874264 >> v2:172.21.15.164:3300/0 conn(0x7f02dc0cf6b0 0x7f02dc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.973+0000 7f02e3800640 1 --2- 172.21.15.153:0/52874264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc073000 0x7f02dc0cc160 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.973+0000 7f02e3800640 1 -- 172.21.15.153:0/52874264 >> 172.21.15.153:0/52874264 conn(0x7f02dc0b1b90 msgr2=0x7f02dc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.981 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi153') 2024-09-17T03:13:06.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.982+0000 7f02e3800640 1 -- 172.21.15.153:0/52874264 shutdown_connections 2024-09-17T03:13:06.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.982+0000 7f02e3800640 1 -- 172.21.15.153:0/52874264 wait complete. 2024-09-17T03:13:06.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.990+0000 7fd439000640 1 -- 172.21.15.153:0/608403538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd434072e70 msgr2=0x7fd434073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:06.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.990+0000 7fd439000640 1 --2- 172.21.15.153:0/608403538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd434072e70 0x7fd434073280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005fd0 tx=0x7fd42c009260 comp rx=0 tx=0).stop 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 -- 172.21.15.153:0/608403538 shutdown_connections 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 --2- 172.21.15.153:0/608403538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd434072e70 0x7fd434073280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 --2- 172.21.15.153:0/608403538 >> v2:172.21.15.153:3300/0 conn(0x7fd43415f030 0x7fd434073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 -- 172.21.15.153:0/608403538 >> 172.21.15.153:0/608403538 conn(0x7fd4340b1b90 msgr2=0x7fd4340b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 -- 172.21.15.153:0/608403538 shutdown_connections 2024-09-17T03:13:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.991+0000 7fd439000640 1 -- 172.21.15.153:0/608403538 wait complete. 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.998+0000 7f02e3800640 1 Processor -- start 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:06.999+0000 7f02e3800640 1 -- start start 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02dc073000 0x7f02dc1f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 0x7f02dc0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc15fe80 con 0x7f02dc0cfac0 2024-09-17T03:13:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc15fd00 con 0x7f02dc073000 2024-09-17T03:13:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.001+0000 7f02e3800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f02dc06ddf0 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.003+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.006+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56822/0 (socket says 172.21.15.153:56822) 2024-09-17T03:13:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.006+0000 7f02dbe00640 1 -- 172.21.15.153:0/3512225889 learned_addr learned my addr 172.21.15.153:0/3512225889 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.006+0000 7f02dbe00640 1 -- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02dc073000 msgr2=0x7f02dc1f9dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:13:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.006+0000 7f02dbe00640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02dc073000 0x7f02dc1f9dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.006+0000 7f02dbe00640 1 -- 172.21.15.153:0/3512225889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 msgr2=0x7f02dc0cdf10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:13:07.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.009+0000 7fd439000640 1 Processor -- start 2024-09-17T03:13:07.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.007+0000 7f02e1800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 0x7f02dc0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.009+0000 7f02dbe00640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 0x7f02dc0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.009+0000 7fd439000640 1 -- start start 2024-09-17T03:13:07.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.010+0000 7f02dbe00640 1 -- 172.21.15.153:0/3512225889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc0a1160 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.010+0000 7f02e1800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 0x7f02dc0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:07.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.011+0000 7f02dbe00640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b9b0 tx=0x7f02d400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.018 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.019+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4019070 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.020+0000 7fd439000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.020+0000 7fd439000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd434072e70 0x7fd4340b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.020+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02d400cc90 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.020+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4019070 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd431e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd439000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 0x7fd4340b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd439000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd43415bd30 con 0x7fd434072e70 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd439000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd43415bbb0 con 0x7fd43415f030 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd439000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd43415beb0 con 0x7fd43406ddf0 2024-09-17T03:13:07.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd431e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56826/0 (socket says 172.21.15.153:56826) 2024-09-17T03:13:07.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd431400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd434072e70 0x7fd4340b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.021+0000 7fd431e00640 1 -- 172.21.15.153:0/228739753 learned_addr learned my addr 172.21.15.153:0/228739753 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd432800640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 0x7fd4340b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 -- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 msgr2=0x7fd4340b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 0x7fd4340b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 -- 172.21.15.153:0/228739753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd434072e70 msgr2=0x7fd4340b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd434072e70 0x7fd4340b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 -- 172.21.15.153:0/228739753 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340b4550 con 0x7fd43406ddf0 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.022+0000 7fd431e00640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd42000b450 tx=0x7fd42000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.023+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420015030 con 0x7fd43406ddf0 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.023+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd420005a60 con 0x7fd43406ddf0 2024-09-17T03:13:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.023+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420006020 con 0x7fd43406ddf0 2024-09-17T03:13:07.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.026+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43415b4f0 con 0x7fd43406ddf0 2024-09-17T03:13:07.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.026+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340b2ed0 con 0x7fd43406ddf0 2024-09-17T03:13:07.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.027+0000 7fd432800640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 0x7fd4340b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:07.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.031+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc09c190 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.031+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1f5c40 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.029+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd420018070 con 0x7fd43406ddf0 2024-09-17T03:13:07.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.029+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd42001a410 con 0x7fd43406ddf0 2024-09-17T03:13:07.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.032+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd434073280 con 0x7fd43406ddf0 2024-09-17T03:13:07.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.034+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02d401c070 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.035+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd420011630 con 0x7fd43406ddf0 2024-09-17T03:13:07.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.040+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02d401d640 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.040+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f492800ef40 con 0x7f492800bff0 2024-09-17T03:13:07.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.040+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc0af640 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.045+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f02dc0af640 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.052+0000 7f4926000640 1 -- 172.21.15.153:0/818318767 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f4928182340 con 0x7f492800bff0 2024-09-17T03:13:07.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 msgr2=0x7f492804d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f491c030040 tx=0x7f491c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 shutdown_connections 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49281819f0 0x7f4928181e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f492800bff0 0x7f492804d8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 --2- 172.21.15.153:0/818318767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4914004800 0x7f492800c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 >> 172.21.15.153:0/818318767 conn(0x7f492800e220 msgr2=0x7f4928039250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.057+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 shutdown_connections 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.058+0000 7f4934800640 1 -- 172.21.15.153:0/818318767 wait complete. 2024-09-17T03:13:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.059+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6168005580 con 0x7f6194169df0 2024-09-17T03:13:07.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.065+0000 7f6191600640 1 -- 172.21.15.153:0/345743517 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f618800ce20 con 0x7f6194169df0 2024-09-17T03:13:07.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.068+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 msgr2=0x7f61940b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.068+0000 7f6186a00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f618800b780 tx=0x7f618800bc40 comp rx=0 tx=0).stop 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 shutdown_connections 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f619406f820 0x7f619406fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6194209ed0 0x7f619420a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 --2- 172.21.15.153:0/345743517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6194169df0 0x7f61940b58f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 >> 172.21.15.153:0/345743517 conn(0x7f61940b1b90 msgr2=0x7f6194071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 shutdown_connections 2024-09-17T03:13:07.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.069+0000 7f6186a00640 1 -- 172.21.15.153:0/345743517 wait complete. 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.067+0000 7f2d3ce00640 1 -- 172.21.15.153:0/3954325416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d3815ee80 msgr2=0x7f2d380d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.070+0000 7f2d34a00640 1 -- 172.21.15.153:0/3954325416 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24035020 con 0x7f2d3815ee80 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.070+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/3954325416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d3815ee80 0x7f2d380d0170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009900 tx=0x7f2d2402a470 comp rx=0 tx=0).stop 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.070+0000 7f2d3ce00640 1 -- 172.21.15.153:0/3954325416 shutdown_connections 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.070+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/3954325416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d3815ee80 0x7f2d380d0170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.070+0000 7f2d3ce00640 1 -- 172.21.15.153:0/3954325416 >> 172.21.15.153:0/3954325416 conn(0x7f2d3809d830 msgr2=0x7f2d380b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.071+0000 7f2d3ce00640 1 -- 172.21.15.153:0/3954325416 shutdown_connections 2024-09-17T03:13:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.071+0000 7f2d3ce00640 1 -- 172.21.15.153:0/3954325416 wait complete. 2024-09-17T03:13:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.072+0000 7f8e3c400640 1 -- 172.21.15.153:0/2482473137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 msgr2=0x7f8e1c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.072+0000 7f8e3c400640 1 --2- 172.21.15.153:0/2482473137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e1c003f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e200064e0 tx=0x7f8e1c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:07.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.077+0000 7f8e3c400640 1 -- 172.21.15.153:0/2482473137 shutdown_connections 2024-09-17T03:13:07.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.077+0000 7f8e3c400640 1 --2- 172.21.15.153:0/2482473137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e1c003f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.077+0000 7f8e3c400640 1 -- 172.21.15.153:0/2482473137 >> 172.21.15.153:0/2482473137 conn(0x7f8e340cca90 msgr2=0x7f8e340ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.079+0000 7f2d3ce00640 1 Processor -- start 2024-09-17T03:13:07.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.079+0000 7f2d3ce00640 1 -- start start 2024-09-17T03:13:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.083+0000 7f8e3c400640 1 -- 172.21.15.153:0/2482473137 shutdown_connections 2024-09-17T03:13:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 0x7f2d38156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 0x7f2d380d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d3815ee80 0x7f2d380d4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b6910 con 0x7f2d380ceb90 2024-09-17T03:13:07.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b6790 con 0x7f2d3815ee80 2024-09-17T03:13:07.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.082+0000 7f2d3ce00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2d380b6a90 con 0x7f2d380b9ad0 2024-09-17T03:13:07.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.084+0000 7f2d35e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 0x7f2d38156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.084+0000 7f2d35e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 0x7f2d38156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56882/0 (socket says 172.21.15.153:56882) 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.084+0000 7f2d35e00640 1 -- 172.21.15.153:0/1999315116 learned_addr learned my addr 172.21.15.153:0/1999315116 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.084+0000 7f2d35400640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 0x7f2d380d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.084+0000 7f2d36800640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d3815ee80 0x7f2d380d4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.086+0000 7f2d35400640 1 -- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 msgr2=0x7f2d38156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.086+0000 7f2d35400640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 0x7f2d38156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.086+0000 7f2d35400640 1 -- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d3815ee80 msgr2=0x7f2d380d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.086+0000 7f2d35400640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d3815ee80 0x7f2d380d4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.086+0000 7f2d35400640 1 -- 172.21.15.153:0/1999315116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3806ecb0 con 0x7f2d380ceb90 2024-09-17T03:13:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.087+0000 7f8e3c400640 1 -- 172.21.15.153:0/2482473137 wait complete. 2024-09-17T03:13:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.088+0000 7f2d35400640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 0x7f2d380d41f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c550 tx=0x7f2d2800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.088+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d280052d0 con 0x7f2d380ceb90 2024-09-17T03:13:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.088+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d28005470 con 0x7f2d380ceb90 2024-09-17T03:13:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.088+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28003830 con 0x7f2d380ceb90 2024-09-17T03:13:07.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.090+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3806f1b0 con 0x7f2d380ceb90 2024-09-17T03:13:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.090+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381f9450 con 0x7f2d380ceb90 2024-09-17T03:13:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.091+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d28012420 con 0x7f2d380ceb90 2024-09-17T03:13:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.091+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2d2801b790 con 0x7f2d380ceb90 2024-09-17T03:13:07.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.093+0000 7fb775000640 1 -- 172.21.15.153:0/2756292659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768037f30 msgr2=0x7fb7680e7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.093+0000 7fb775000640 1 --2- 172.21.15.153:0/2756292659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768037f30 0x7fb7680e7330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009830 tx=0x7fb75c02a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7fb775000640 1 -- 172.21.15.153:0/2756292659 shutdown_connections 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7fb775000640 1 --2- 172.21.15.153:0/2756292659 >> v2:172.21.15.153:3300/0 conn(0x7fb768006f20 0x7fb768053360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7fb775000640 1 --2- 172.21.15.153:0/2756292659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768037f30 0x7fb7680e7330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7fb775000640 1 -- 172.21.15.153:0/2756292659 >> 172.21.15.153:0/2756292659 conn(0x7fb76800e200 msgr2=0x7fb76800e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d38160270 con 0x7f2d380ceb90 2024-09-17T03:13:07.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.098+0000 7f8e3c400640 1 Processor -- start 2024-09-17T03:13:07.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.100+0000 7fb775000640 1 -- 172.21.15.153:0/2756292659 shutdown_connections 2024-09-17T03:13:07.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.100+0000 7fb775000640 1 -- 172.21.15.153:0/2756292659 wait complete. 2024-09-17T03:13:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.105+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d28020060 con 0x7f2d380ceb90 2024-09-17T03:13:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.101+0000 7f7c8a200640 1 -- 172.21.15.153:0/4280541109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c6c005150 msgr2=0x7f7c6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.101+0000 7f7c8a200640 1 --2- 172.21.15.153:0/4280541109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c6c005150 0x7f7c6c00b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b610 tx=0x7f7c6c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.104+0000 7f7c83e00640 1 -- 172.21.15.153:0/4280541109 reap_dead start 2024-09-17T03:13:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.104+0000 7f7c8a200640 1 -- 172.21.15.153:0/4280541109 shutdown_connections 2024-09-17T03:13:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.104+0000 7f7c8a200640 1 -- 172.21.15.153:0/4280541109 >> 172.21.15.153:0/4280541109 conn(0x7f7c840d4320 msgr2=0x7f7c840d4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.104+0000 7f7c8a200640 1 -- 172.21.15.153:0/4280541109 shutdown_connections 2024-09-17T03:13:07.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.105+0000 7f7c8a200640 1 -- 172.21.15.153:0/4280541109 wait complete. 2024-09-17T03:13:07.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.107+0000 7ff13ca00640 1 -- 172.21.15.153:0/744127186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 msgr2=0x7ff13806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.108+0000 7ff13ca00640 1 --2- 172.21.15.153:0/744127186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13806da60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff1380729d0 tx=0x7ff12402a420 comp rx=0 tx=0).stop 2024-09-17T03:13:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.108+0000 7ff13ca00640 1 -- 172.21.15.153:0/744127186 shutdown_connections 2024-09-17T03:13:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.108+0000 7ff13ca00640 1 --2- 172.21.15.153:0/744127186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13806da60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.108+0000 7ff13ca00640 1 --2- 172.21.15.153:0/744127186 >> v2:172.21.15.153:3300/0 conn(0x7ff1380aef90 0x7ff138155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.108+0000 7ff13ca00640 1 -- 172.21.15.153:0/744127186 >> 172.21.15.153:0/744127186 conn(0x7ff1380cfec0 msgr2=0x7ff1380d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.102+0000 7f8e3c400640 1 -- start start 2024-09-17T03:13:07.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e3415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.114+0000 7fb775000640 1 Processor -- start 2024-09-17T03:13:07.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 0x7f8e340b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.115+0000 7fb775000640 1 -- start start 2024-09-17T03:13:07.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e340b5480 0x7f8e34201d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3406cde0 con 0x7f8e340b5480 2024-09-17T03:13:07.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e340cbc80 con 0x7f8e340b4b30 2024-09-17T03:13:07.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e3c400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3406cf60 con 0x7f8e1c003a70 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.111+0000 7f8e39000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 0x7f8e340b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.112+0000 7f8e39000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 0x7f8e340b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33596/0 (socket says 172.21.15.153:33596) 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.112+0000 7f8e39000640 1 -- 172.21.15.153:0/2764385264 learned_addr learned my addr 172.21.15.153:0/2764385264 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.112+0000 7f8e39a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e3415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.112+0000 7f8e3ae00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e340b5480 0x7f8e34201d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.113+0000 7f8e39a00640 1 -- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 msgr2=0x7f8e340b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.113+0000 7f8e39a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 0x7f8e340b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.113+0000 7f8e39a00640 1 -- 172.21.15.153:0/2764385264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e340b5480 msgr2=0x7f8e34201d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.113+0000 7f8e39a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e340b5480 0x7f8e34201d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.113+0000 7f8e39a00640 1 -- 172.21.15.153:0/2764385264 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3415fa90 con 0x7f8e1c003a70 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.114+0000 7f8e39a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e3415ea10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c820 tx=0x7f8e20008f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.115+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200035f0 con 0x7f8e1c003a70 2024-09-17T03:13:07.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.115+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e20003d20 con 0x7f8e1c003a70 2024-09-17T03:13:07.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.115+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200306e0 con 0x7f8e1c003a70 2024-09-17T03:13:07.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.116+0000 7f7c8a200640 1 Processor -- start 2024-09-17T03:13:07.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.116+0000 7f7c8a200640 1 -- start start 2024-09-17T03:13:07.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.116+0000 7f8e3c400640 1 -- 172.21.15.153:0/2764385264 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3415f0b0 con 0x7f8e1c003a70 2024-09-17T03:13:07.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.117+0000 7f8e3c400640 1 -- 172.21.15.153:0/2764385264 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e340b4330 con 0x7f8e1c003a70 2024-09-17T03:13:07.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.119+0000 7f7c8a200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.119+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e08005290 con 0x7f8e1c003a70 2024-09-17T03:13:07.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.121+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e20037040 con 0x7f8e1c003a70 2024-09-17T03:13:07.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.121+0000 7ff13ca00640 1 -- 172.21.15.153:0/744127186 shutdown_connections 2024-09-17T03:13:07.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.121+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e2005bad0 con 0x7f8e1c003a70 2024-09-17T03:13:07.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.123+0000 7ff13ca00640 1 -- 172.21.15.153:0/744127186 wait complete. 2024-09-17T03:13:07.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8e2006a030 con 0x7f8e1c003a70 2024-09-17T03:13:07.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.124+0000 7fb775000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb768006f20 0x7fb76800ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.124+0000 7fb775000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.124+0000 7fb775000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb768037f30 0x7fb7681820d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb775000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680eb5b0 con 0x7fb768037f30 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb775000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb768053bf0 con 0x7fb768007330 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb775000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb7680eb730 con 0x7fb768006f20 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb76ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33610/0 (socket says 172.21.15.153:33610) 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.125+0000 7fb76ea00640 1 -- 172.21.15.153:0/2338664119 learned_addr learned my addr 172.21.15.153:0/2338664119 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76f400640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb768006f20 0x7fb76800ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.126 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c8a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 0x7f7c841f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c8a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c84151c50 0x7f7c84152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c83400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c83400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56898/0 (socket says 172.21.15.153:56898) 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c8a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c84155a40 con 0x7f7c84151c50 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c8a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7c84154ee0 con 0x7f7c84073bf0 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c82a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 0x7f7c841f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c8a200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7c841f3e60 con 0x7f7c6c005150 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c82a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 0x7f7c841f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33616/0 (socket says 172.21.15.153:33616) 2024-09-17T03:13:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.127+0000 7f7c83400640 1 -- 172.21.15.153:0/3748099190 learned_addr learned my addr 172.21.15.153:0/3748099190 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 -- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 msgr2=0x7f7c841f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 0x7f7c841f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 -- 172.21.15.153:0/3748099190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c84151c50 msgr2=0x7f7c84152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c84151c50 0x7f7c84152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 -- 172.21.15.153:0/3748099190 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c841525a0 con 0x7f7c6c005150 2024-09-17T03:13:07.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76ea00640 1 -- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb768006f20 msgr2=0x7fb76800ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76ea00640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb768006f20 0x7fb76800ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76ea00640 1 -- 172.21.15.153:0/2338664119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb768037f30 msgr2=0x7fb7681820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76ea00640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb768037f30 0x7fb7681820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.126+0000 7fb76ea00640 1 -- 172.21.15.153:0/2338664119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76800bae0 con 0x7fb768007330 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c83400640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c001ec0 tx=0x7f7c7c006860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c015070 con 0x7f7c6c005150 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.128+0000 7f7c8a200640 1 -- 172.21.15.153:0/3748099190 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c841f1d60 con 0x7f7c6c005150 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.129+0000 7f7c8a200640 1 -- 172.21.15.153:0/3748099190 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c841f2320 con 0x7f7c6c005150 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.130+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c60005290 con 0x7f7c6c005150 2024-09-17T03:13:07.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.131+0000 7fb76ea00640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d730 tx=0x7fb76400dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.132+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764017070 con 0x7fb768007330 2024-09-17T03:13:07.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb764009ac0 con 0x7fb768007330 2024-09-17T03:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764010460 con 0x7fb768007330 2024-09-17T03:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76800bdc0 con 0x7fb768007330 2024-09-17T03:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76800c380 con 0x7fb768007330 2024-09-17T03:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.131+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c7c00ce20 con 0x7f7c6c005150 2024-09-17T03:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.132+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c015070 con 0x7f7c6c005150 2024-09-17T03:13:07.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c7c0257d0 con 0x7f7c6c005150 2024-09-17T03:13:07.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.133+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c7c00cc20 con 0x7f7c6c005150 2024-09-17T03:13:07.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.132+0000 7ff13ca00640 1 Processor -- start 2024-09-17T03:13:07.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.132+0000 7ff13ca00640 1 -- start start 2024-09-17T03:13:07.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.135+0000 7ff13ca00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.136+0000 7ff13ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 0x7ff13815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.136+0000 7ff137400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.136+0000 7ff137400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56910/0 (socket says 172.21.15.153:56910) 2024-09-17T03:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.136+0000 7ff137400640 1 -- 172.21.15.153:0/807471252 learned_addr learned my addr 172.21.15.153:0/807471252 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.137+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7680ebc50 con 0x7fb768007330 2024-09-17T03:13:07.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.137+0000 7ff13ca00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.138+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1380ce150 con 0x7ff1380aef90 2024-09-17T03:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.138+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c841525a0 con 0x7f7c6c005150 2024-09-17T03:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.139+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff1380cdfd0 con 0x7ff13815f670 2024-09-17T03:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.140+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff1380ce2d0 con 0x7ff138070050 2024-09-17T03:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.141+0000 7ff137e00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.141+0000 7ff136a00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 0x7ff13815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.143+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb76401a070 con 0x7fb768007330 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 -- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 msgr2=0x7ff13815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 -- 172.21.15.153:0/807471252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 msgr2=0x7ff13815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 0x7ff13815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1381576c0 con 0x7ff138070050 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff136a00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 0x7ff13815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.142+0000 7ff137400640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff12800d770 tx=0x7ff12800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.143+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb76401cad0 con 0x7fb768007330 2024-09-17T03:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.143+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128017070 con 0x7ff138070050 2024-09-17T03:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.143+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128009d20 con 0x7ff138070050 2024-09-17T03:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.143+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1280106c0 con 0x7ff138070050 2024-09-17T03:13:07.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.146+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb764010600 con 0x7fb768007330 2024-09-17T03:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.144+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1381579a0 con 0x7ff138070050 2024-09-17T03:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.144+0000 7ff137e00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.146+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff138158e50 con 0x7ff138070050 2024-09-17T03:13:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.149+0000 7ff463a00640 1 -- 172.21.15.153:0/3918623891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444004800 msgr2=0x7ff444004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.141+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1ee0005850 con 0x7f1f0c152dd0 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.149+0000 7ff463a00640 1 --2- 172.21.15.153:0/3918623891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444004800 0x7ff444004c10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff44800a500 tx=0x7ff444005830 comp rx=0 tx=0).stop 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff461000640 1 -- 172.21.15.153:0/3918623891 reap_dead start 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff463a00640 1 -- 172.21.15.153:0/3918623891 shutdown_connections 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff463a00640 1 -- 172.21.15.153:0/3918623891 >> 172.21.15.153:0/3918623891 conn(0x7ff45c0d0010 msgr2=0x7ff45c0d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff463a00640 1 -- 172.21.15.153:0/3918623891 shutdown_connections 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.149+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1380ce820 con 0x7ff138070050 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff12801a070 con 0x7ff138070050 2024-09-17T03:13:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff12801cb50 con 0x7ff138070050 2024-09-17T03:13:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.150+0000 7ff463a00640 1 -- 172.21.15.153:0/3918623891 wait complete. 2024-09-17T03:13:07.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.157+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff128010860 con 0x7ff138070050 2024-09-17T03:13:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.158+0000 7ff463a00640 1 Processor -- start 2024-09-17T03:13:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.159+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f1b88005850 con 0x7f1bac15ed20 2024-09-17T03:13:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.158+0000 7f1f02a00640 1 -- 172.21.15.153:0/2461700249 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f1efc01dbb0 con 0x7f1f0c152dd0 2024-09-17T03:13:07.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.161+0000 7ff463a00640 1 -- start start 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 msgr2=0x7f1f0c155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 0x7f1f0c155950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c310 tx=0x7f1efc00c7d0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 shutdown_connections 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f0c152dd0 0x7f1f0c155950 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f0c073ba0 0x7f1f0c143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 --2- 172.21.15.153:0/2461700249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f0c06edf0 0x7f1f0c143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 >> 172.21.15.153:0/2461700249 conn(0x7f1f0c06cde0 msgr2=0x7f1f0c0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 shutdown_connections 2024-09-17T03:13:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.163+0000 7f1ef7e00640 1 -- 172.21.15.153:0/2461700249 wait complete. 2024-09-17T03:13:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.165+0000 7ff463a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 0x7ff45c09d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.165+0000 7ff463a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff45b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff45b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57718/0 (socket says 172.21.15.153:57718) 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff45be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 0x7ff45c09d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff45be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 0x7ff45c09d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56922/0 (socket says 172.21.15.153:56922) 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff45b400640 1 -- 172.21.15.153:0/877357077 learned_addr learned my addr 172.21.15.153:0/877357077 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7ff463a00640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 0x7ff45c1f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.167+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c0acfe0 con 0x7ff45c1f47f0 2024-09-17T03:13:07.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.166+0000 7f1ba9600640 1 -- 172.21.15.153:0/370474063 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7f1b980193b0 con 0x7f1bac15ed20 2024-09-17T03:13:07.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.167+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c0ace60 con 0x7ff45c1f1200 2024-09-17T03:13:07.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.167+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c0ad6c0 con 0x7ff45c074a70 2024-09-17T03:13:07.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.167+0000 7ff461000640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 0x7ff45c1f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.168+0000 7ff45b400640 1 -- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 msgr2=0x7ff45c09d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.169+0000 7ff45b400640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 0x7ff45c09d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.169+0000 7ff45b400640 1 -- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 msgr2=0x7ff45c1f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.169+0000 7ff45b400640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 0x7ff45c1f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.169+0000 7ff45b400640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1f5140 con 0x7ff45c1f47f0 2024-09-17T03:13:07.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.170+0000 7ff461000640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 0x7ff45c1f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:07.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.170+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 msgr2=0x7f1bac13fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.170+0000 7f1bb3000640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800b3f0 tx=0x7f1b9800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.170+0000 7ff45b400640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff448034040 tx=0x7ff448003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.171+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44803e020 con 0x7ff45c1f47f0 2024-09-17T03:13:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.171+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff448004a90 con 0x7ff45c1f47f0 2024-09-17T03:13:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.171+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c0c5780 con 0x7ff45c1f47f0 2024-09-17T03:13:07.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.173+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44800a180 con 0x7ff45c1f47f0 2024-09-17T03:13:07.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.173+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c0c5a20 con 0x7ff45c1f47f0 2024-09-17T03:13:07.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.174+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff448041020 con 0x7ff45c1f47f0 2024-09-17T03:13:07.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.174+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff44803a5a0 con 0x7ff45c1f47f0 2024-09-17T03:13:07.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.176+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 shutdown_connections 2024-09-17T03:13:07.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.176+0000 7f1bb3000640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bac1403c0 0x7f1bac0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.176+0000 7f1bb3000640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac15ed20 0x7f1bac13fe80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.176+0000 7f1bb3000640 1 --2- 172.21.15.153:0/370474063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1bac074820 0x7f1bac202bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.176+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 >> 172.21.15.153:0/370474063 conn(0x7f1bac0cfec0 msgr2=0x7f1bac0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.177+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c15ec50 con 0x7ff45c1f47f0 2024-09-17T03:13:07.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.178+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 shutdown_connections 2024-09-17T03:13:07.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.178+0000 7f1bb3000640 1 -- 172.21.15.153:0/370474063 wait complete. 2024-09-17T03:13:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.187+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff448048070 con 0x7ff45c1f47f0 2024-09-17T03:13:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.191+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fd4340c3250 con 0x7fd43406ddf0 2024-09-17T03:13:07.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.197+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f02dc0cc160 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.203+0000 7fd42a000640 1 -- 172.21.15.153:0/228739753 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7fd4200061c0 con 0x7fd43406ddf0 2024-09-17T03:13:07.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.205+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 msgr2=0x7fd43409b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.205+0000 7fd439000640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd42000b450 tx=0x7fd42000b910 comp rx=0 tx=0).stop 2024-09-17T03:13:07.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 shutdown_connections 2024-09-17T03:13:07.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd43415f030 0x7fd4340b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd434072e70 0x7fd4340b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 --2- 172.21.15.153:0/228739753 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd43406ddf0 0x7fd43409b560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 >> 172.21.15.153:0/228739753 conn(0x7fd4340b1b90 msgr2=0x7fd4340c28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 shutdown_connections 2024-09-17T03:13:07.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.206+0000 7fd439000640 1 -- 172.21.15.153:0/228739753 wait complete. 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.222+0000 7f02d8c00640 1 -- 172.21.15.153:0/3512225889 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f02dc0af640 con 0x7f02dc0cf6b0 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 msgr2=0x7f02dc1f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b9b0 tx=0x7f02d400be70 comp rx=0 tx=0).stop 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 shutdown_connections 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc0cfac0 0x7f02dc0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f02dc0cf6b0 0x7f02dc1f5700 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 --2- 172.21.15.153:0/3512225889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02dc073000 0x7f02dc1f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.224+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 >> 172.21.15.153:0/3512225889 conn(0x7f02dc0b1b90 msgr2=0x7f02dc1609c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.228+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 shutdown_connections 2024-09-17T03:13:07.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.228+0000 7f02e3800640 1 -- 172.21.15.153:0/3512225889 wait complete. 2024-09-17T03:13:07.240 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.240 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.279 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.280 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.280 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.286+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f2d380b4280 con 0x7f2d380ceb90 2024-09-17T03:13:07.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.288+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8e08005850 con 0x7f8e1c003a70 2024-09-17T03:13:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.292+0000 7f2d2e000640 1 -- 172.21.15.153:0/1999315116 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7f2d2801b9e0 con 0x7f2d380ceb90 2024-09-17T03:13:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 msgr2=0x7f2d380d41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 0x7f2d380d41f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c550 tx=0x7f2d2800ca10 comp rx=0 tx=0).stop 2024-09-17T03:13:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 shutdown_connections 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d3815ee80 0x7f2d380d4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d380ceb90 0x7f2d380d41f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 --2- 172.21.15.153:0/1999315116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d380b9ad0 0x7f2d38156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.294+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 >> 172.21.15.153:0/1999315116 conn(0x7f2d3809d830 msgr2=0x7f2d3815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.295+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 shutdown_connections 2024-09-17T03:13:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.295+0000 7f2d3ce00640 1 -- 172.21.15.153:0/1999315116 wait complete. 2024-09-17T03:13:07.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.301+0000 7f8e31600640 1 -- 172.21.15.153:0/2764385264 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f8e20061030 con 0x7f8e1c003a70 2024-09-17T03:13:07.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.302+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 msgr2=0x7f8e3415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.302+0000 7f8e26a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e3415ea10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c820 tx=0x7f8e20008f50 comp rx=0 tx=0).stop 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 shutdown_connections 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e340b5480 0x7f8e34201d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e340b4b30 0x7f8e340b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 --2- 172.21.15.153:0/2764385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e1c003a70 0x7f8e3415ea10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 >> 172.21.15.153:0/2764385264 conn(0x7f8e340cca90 msgr2=0x7f8e3406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 shutdown_connections 2024-09-17T03:13:07.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.303+0000 7f8e26a00640 1 -- 172.21.15.153:0/2764385264 wait complete. 2024-09-17T03:13:07.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.304+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fb76800ef20 con 0x7fb768007330 2024-09-17T03:13:07.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.310+0000 7fb763400640 1 -- 172.21.15.153:0/2338664119 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7fb7640047e0 con 0x7fb768007330 2024-09-17T03:13:07.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.311+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 msgr2=0x7fb768181b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.311+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7c60005580 con 0x7f7c6c005150 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.311+0000 7fb775000640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb76400d730 tx=0x7fb76400dbf0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.312+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 shutdown_connections 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.312+0000 7fb775000640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb768037f30 0x7fb7681820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.312+0000 7fb775000640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb768007330 0x7fb768181b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.312+0000 7fb775000640 1 --2- 172.21.15.153:0/2338664119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb768006f20 0x7fb76800ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.312+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 >> 172.21.15.153:0/2338664119 conn(0x7fb76800e200 msgr2=0x7fb76803ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.313+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 shutdown_connections 2024-09-17T03:13:07.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.313+0000 7fb775000640 1 -- 172.21.15.153:0/2338664119 wait complete. 2024-09-17T03:13:07.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.321+0000 7f7c77400640 1 -- 172.21.15.153:0/3748099190 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7f7c7c011d60 con 0x7f7c6c005150 2024-09-17T03:13:07.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.322+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff1380696c0 con 0x7ff138070050 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 msgr2=0x7f7c8415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c001ec0 tx=0x7f7c7c006860 comp rx=0 tx=0).stop 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 shutdown_connections 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c84151c50 0x7f7c84152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c84073bf0 0x7f7c841f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 --2- 172.21.15.153:0/3748099190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7c6c005150 0x7f7c8415de50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 >> 172.21.15.153:0/3748099190 conn(0x7f7c840d4320 msgr2=0x7f7c84160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 shutdown_connections 2024-09-17T03:13:07.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.323+0000 7f7c74c00640 1 -- 172.21.15.153:0/3748099190 wait complete. 2024-09-17T03:13:07.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.326+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff45c072db0 con 0x7ff45c1f47f0 2024-09-17T03:13:07.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.328+0000 7ff12f400640 1 -- 172.21.15.153:0/807471252 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7ff128010a40 con 0x7ff138070050 2024-09-17T03:13:07.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 msgr2=0x7ff138201870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff12800d770 tx=0x7ff12800dc30 comp rx=0 tx=0).stop 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 shutdown_connections 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff13815f670 0x7ff13815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1380aef90 0x7ff13815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 --2- 172.21.15.153:0/807471252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff138070050 0x7ff138201870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.330+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 >> 172.21.15.153:0/807471252 conn(0x7ff1380cfec0 msgr2=0x7ff13815cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.331+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 shutdown_connections 2024-09-17T03:13:07.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.331+0000 7ff13ca00640 1 -- 172.21.15.153:0/807471252 wait complete. 2024-09-17T03:13:07.331 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.335+0000 7ff458c00640 1 -- 172.21.15.153:0/877357077 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7ff45c1f5140 con 0x7ff45c1f47f0 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 msgr2=0x7ff45c1f4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff448034040 tx=0x7ff448003df0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 shutdown_connections 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff45c1f1200 0x7ff45c1f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff45c1f47f0 0x7ff45c1f4c00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 --2- 172.21.15.153:0/877357077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff45c074a70 0x7ff45c09d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 >> 172.21.15.153:0/877357077 conn(0x7ff45c0d0010 msgr2=0x7ff45c15bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 shutdown_connections 2024-09-17T03:13:07.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.336+0000 7ff463a00640 1 -- 172.21.15.153:0/877357077 wait complete. 2024-09-17T03:13:07.347 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.357 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.358 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.358 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi153') 2024-09-17T03:13:07.366 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config dump 2024-09-17T03:13:07.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 -- 172.21.15.153:0/2558834222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f645006ddf0 msgr2=0x7f645006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 --2- 172.21.15.153:0/2558834222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f645006ddf0 0x7f645006e200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6450076360 tx=0x7f644802aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 -- 172.21.15.153:0/2558834222 shutdown_connections 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 --2- 172.21.15.153:0/2558834222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f645006ddf0 0x7f645006e200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 --2- 172.21.15.153:0/2558834222 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 0x7f64500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 --2- 172.21.15.153:0/2558834222 >> v2:172.21.15.164:3300/0 conn(0x7f6450074cb0 0x7f6450073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 -- 172.21.15.153:0/2558834222 >> 172.21.15.153:0/2558834222 conn(0x7f64500cca40 msgr2=0x7f64500cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 -- 172.21.15.153:0/2558834222 shutdown_connections 2024-09-17T03:13:07.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.623+0000 7f6455200640 1 -- 172.21.15.153:0/2558834222 wait complete. 2024-09-17T03:13:07.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.626+0000 7f6455200640 1 Processor -- start 2024-09-17T03:13:07.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.626+0000 7f6455200640 1 -- start start 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 0x7f64501f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 0x7f645015be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f645006f170 con 0x7f6450074cb0 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f645006eff0 con 0x7f645006ddf0 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f6455200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f645006f2f0 con 0x7f64500cbc10 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f644de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f644d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 0x7f64501f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f644de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33662/0 (socket says 172.21.15.153:33662) 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.627+0000 7f644de00640 1 -- 172.21.15.153:0/3842598463 learned_addr learned my addr 172.21.15.153:0/3842598463 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644e800640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 0x7f645015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 -- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 msgr2=0x7f645015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 0x7f645015be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 -- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 msgr2=0x7f64501f94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 -- 172.21.15.153:0/3842598463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64501f99e0 con 0x7f6450074cb0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644de00640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f644d400640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 0x7f64501f4d00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e6f0 tx=0x7f643c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.628+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c004220 con 0x7f6450074cb0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f643c00c8b0 con 0x7f6450074cb0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c00cd00 con 0x7f6450074cb0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64501f58f0 con 0x7f6450074cb0 2024-09-17T03:13:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501f5eb0 con 0x7f6450074cb0 2024-09-17T03:13:07.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f643c0053b0 con 0x7f6450074cb0 2024-09-17T03:13:07.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.629+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f643c003b50 con 0x7f6450074cb0 2024-09-17T03:13:07.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.630+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64501f5660 con 0x7f6450074cb0 2024-09-17T03:13:07.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.632+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f64501f99e0 con 0x7f6450074cb0 2024-09-17T03:13:07.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.695+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6450073dd0 con 0x7f6450074cb0 2024-09-17T03:13:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.696+0000 7f6446000640 1 -- 172.21.15.153:0/3842598463 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f643c003d50 con 0x7f6450074cb0 2024-09-17T03:13:07.695 INFO:teuthology.orchestra.run.smithi153.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_client 20/20 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds 20/20 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_ms 2/2 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_frag true 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:13:07.696 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_verify_scatter true 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced client_mount_timeout 600 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_client 20/20 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_ms 1/1 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:13:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 msgr2=0x7f64501f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 0x7f64501f4d00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f643c00e6f0 tx=0x7f643c00ebb0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 shutdown_connections 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f64500cbc10 0x7f645015be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6450074cb0 0x7f64501f4d00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 --2- 172.21.15.153:0/3842598463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f645006ddf0 0x7f64501f94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 >> 172.21.15.153:0/3842598463 conn(0x7f64500cca40 msgr2=0x7f64500cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 shutdown_connections 2024-09-17T03:13:07.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.697+0000 7f6455200640 1 -- 172.21.15.153:0/3842598463 wait complete. 2024-09-17T03:13:07.718 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T03:13:07.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.938+0000 7fde93c00640 1 -- 172.21.15.153:0/4151554165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c06e500 msgr2=0x7fde8c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.938+0000 7fde93c00640 1 --2- 172.21.15.153:0/4151554165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c06e500 0x7fde8c0cf290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde78005fd0 tx=0x7fde7802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 -- 172.21.15.153:0/4151554165 shutdown_connections 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 --2- 172.21.15.153:0/4151554165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0cf7d0 0x7fde8c072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 --2- 172.21.15.153:0/4151554165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c06e500 0x7fde8c0cf290 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 -- 172.21.15.153:0/4151554165 >> 172.21.15.153:0/4151554165 conn(0x7fde8c0b1b90 msgr2=0x7fde8c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:07.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 -- 172.21.15.153:0/4151554165 shutdown_connections 2024-09-17T03:13:07.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.939+0000 7fde93c00640 1 -- 172.21.15.153:0/4151554165 wait complete. 2024-09-17T03:13:07.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.941+0000 7fde93c00640 1 Processor -- start 2024-09-17T03:13:07.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.941+0000 7fde93c00640 1 -- start start 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde8c15fc50 0x7fde8c0a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0c32c0 0x7fde8c0a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c0732d0 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c0cfcf0 con 0x7fde8c15fc50 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.942+0000 7fde93c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fde8c073450 con 0x7fde8c0c32c0 2024-09-17T03:13:07.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde8be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde8c15fc50 0x7fde8c0a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0c32c0 0x7fde8c0a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57752/0 (socket says 172.21.15.153:57752) 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 -- 172.21.15.153:0/259582042 learned_addr learned my addr 172.21.15.153:0/259582042 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 -- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0c32c0 msgr2=0x7fde8c0a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0c32c0 0x7fde8c0a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 -- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde8c15fc50 msgr2=0x7fde8c0a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde8c15fc50 0x7fde8c0a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 -- 172.21.15.153:0/259582042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c159440 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.943+0000 7fde91200640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c3d0 tx=0x7fde8000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:07.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80017070 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde800053c0 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80003850 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8c1f6fb0 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8c1f7570 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde8001a070 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.944+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fde8001c780 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.945+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8c0c36d0 con 0x7fde8c0cf7d0 2024-09-17T03:13:07.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:07.947+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fde80021020 con 0x7fde8c0cf7d0 2024-09-17T03:13:08.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.015+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fde8c073970 con 0x7fde8c0cf7d0 2024-09-17T03:13:08.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.018+0000 7fde88c00640 1 -- 172.21.15.153:0/259582042 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fde8c159440 con 0x7fde8c0cf7d0 2024-09-17T03:13:08.017 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 msgr2=0x7fde8c1e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c3d0 tx=0x7fde8000c890 comp rx=0 tx=0).stop 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 shutdown_connections 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde8c0c32c0 0x7fde8c0a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde8c15fc50 0x7fde8c0a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 --2- 172.21.15.153:0/259582042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde8c0cf7d0 0x7fde8c1e62a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 >> 172.21.15.153:0/259582042 conn(0x7fde8c0b1b90 msgr2=0x7fde8c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 shutdown_connections 2024-09-17T03:13:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:08.019+0000 7fde93c00640 1 -- 172.21.15.153:0/259582042 wait complete. 2024-09-17T03:13:08.042 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T03:13:08.042 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T03:13:08.042 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:08.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T03:13:08.098 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:08.098 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T03:13:08.194 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:08.194 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T03:13:08.291 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:08.291 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T03:13:08.388 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:08.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T03:13:08.444 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:08.444 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T03:13:08.540 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:08.540 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T03:13:08.637 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:13:08.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T03:13:08.733 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 47dd9710-4d40-47dc-9abb-ead02c09be00 0 2024-09-17T03:13:08.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 -- 172.21.15.164:0/2477996696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 msgr2=0x7f2d900cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:08.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 --2- 172.21.15.164:0/2477996696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900cfa10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009be0 tx=0x7f2d8802a890 comp rx=0 tx=0).stop 2024-09-17T03:13:08.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 -- 172.21.15.164:0/2477996696 shutdown_connections 2024-09-17T03:13:08.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 --2- 172.21.15.164:0/2477996696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900cfa10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 -- 172.21.15.164:0/2477996696 >> 172.21.15.164:0/2477996696 conn(0x7f2d900d1960 msgr2=0x7f2d900d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:08.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 -- 172.21.15.164:0/2477996696 shutdown_connections 2024-09-17T03:13:08.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.995+0000 7f2d95c00640 1 -- 172.21.15.164:0/2477996696 wait complete. 2024-09-17T03:13:08.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.997+0000 7f2d95c00640 1 Processor -- start 2024-09-17T03:13:08.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.997+0000 7f2d95c00640 1 -- start start 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.998+0000 7f2d95c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 0x7f2d901f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d901f8a90 0x7f2d901f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2d901555f0 con 0x7f2d901f8a90 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d90155470 con 0x7f2d9006d2b0 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2d90155770 con 0x7f2d900d3280 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 0x7f2d901f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:43878/0 (socket says 172.21.15.164:43878) 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 -- 172.21.15.164:0/57109912 learned_addr learned my addr 172.21.15.164:0/57109912 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d95200640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d901f8a90 0x7f2d901f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:08.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 -- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 msgr2=0x7f2d901f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 0x7f2d901f8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 -- 172.21.15.164:0/57109912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d901f8a90 msgr2=0x7f2d901f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d901f8a90 0x7f2d901f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8f400640 1 -- 172.21.15.164:0/57109912 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d900c9c30 con 0x7f2d900d3280 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:08.999+0000 7f2d8fe00640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 0x7f2d901f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:08.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d8f400640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c460 tx=0x7f2d7c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0052d0 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d7c005490 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d900c9f10 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c012870 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d900ca4d0 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d7c012a10 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.000+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2d7c01b8a0 con 0x7f2d900d3280 2024-09-17T03:13:09.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.001+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d900d06d0 con 0x7f2d900d3280 2024-09-17T03:13:09.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.004+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d900d06d0 con 0x7f2d900d3280 2024-09-17T03:13:09.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.079+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "47dd9710-4d40-47dc-9abb-ead02c09be00", "id": 0} v 0) -- 0x7f2d901621d0 con 0x7f2d900d3280 2024-09-17T03:13:09.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.085+0000 7f2d87e00640 1 -- 172.21.15.164:0/57109912 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47dd9710-4d40-47dc-9abb-ead02c09be00", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2d7c01baa0 con 0x7f2d900d3280 2024-09-17T03:13:09.083 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-17T03:13:09.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 msgr2=0x7f2d900c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00c460 tx=0x7f2d7c00c920 comp rx=0 tx=0).stop 2024-09-17T03:13:09.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 shutdown_connections 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d901f8a90 0x7f2d901f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d900d3280 0x7f2d900c8f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 --2- 172.21.15.164:0/57109912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9006d2b0 0x7f2d901f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 >> 172.21.15.164:0/57109912 conn(0x7f2d900d1960 msgr2=0x7f2d900b9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 shutdown_connections 2024-09-17T03:13:09.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.086+0000 7f2d95c00640 1 -- 172.21.15.164:0/57109912 wait complete. 2024-09-17T03:13:09.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new cf8012e5-5da1-44b4-8711-836bcce71f1a 1 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 -- 172.21.15.164:0/571590231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a9406d2b0 msgr2=0x7f8a941621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 --2- 172.21.15.164:0/571590231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a9406d2b0 0x7f8a941621d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a9408cea0 tx=0x7f8a8402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 -- 172.21.15.164:0/571590231 shutdown_connections 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 --2- 172.21.15.164:0/571590231 >> v2:172.21.15.153:3300/0 conn(0x7f8a94162710 0x7f8a940cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 --2- 172.21.15.164:0/571590231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a9406d2b0 0x7f8a941621d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 -- 172.21.15.164:0/571590231 >> 172.21.15.164:0/571590231 conn(0x7f8a940d1960 msgr2=0x7f8a940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 -- 172.21.15.164:0/571590231 shutdown_connections 2024-09-17T03:13:09.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.326+0000 7f8a99400640 1 -- 172.21.15.164:0/571590231 wait complete. 2024-09-17T03:13:09.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.328+0000 7f8a99400640 1 Processor -- start 2024-09-17T03:13:09.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.328+0000 7f8a99400640 1 -- start start 2024-09-17T03:13:09.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a940cf840 0x7f8a941f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a94162710 0x7f8a94152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94155940 con 0x7f8a9406d2b0 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941557c0 con 0x7f8a940cf840 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a99400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a94155ac0 con 0x7f8a94162710 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.164:34788/0 (socket says 172.21.15.164:34788) 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 -- 172.21.15.164:0/2463330874 learned_addr learned my addr 172.21.15.164:0/2463330874 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93400640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a940cf840 0x7f8a941f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a98a00640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a94162710 0x7f8a94152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 -- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a94162710 msgr2=0x7f8a94152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a94162710 0x7f8a94152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 -- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a940cf840 msgr2=0x7f8a941f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a940cf840 0x7f8a941f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.330+0000 7f8a93e00640 1 -- 172.21.15.164:0/2463330874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a94151f60 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a93e00640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a84034040 tx=0x7f8a84003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8403e030 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a84003d10 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a94152240 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84035040 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.331+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a941f6c30 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.332+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a84041030 con 0x7f8a9406d2b0 2024-09-17T03:13:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.332+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8a84043d00 con 0x7f8a9406d2b0 2024-09-17T03:13:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.333+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a94151cc0 con 0x7f8a9406d2b0 2024-09-17T03:13:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.337+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8a84004d50 con 0x7f8a9406d2b0 2024-09-17T03:13:09.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.419+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf8012e5-5da1-44b4-8711-836bcce71f1a", "id": 1} v 0) -- 0x7f8a941621d0 con 0x7f8a9406d2b0 2024-09-17T03:13:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.422+0000 7f8a8be00640 1 -- 172.21.15.164:0/2463330874 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf8012e5-5da1-44b4-8711-836bcce71f1a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8a84004f30 con 0x7f8a9406d2b0 2024-09-17T03:13:09.420 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 msgr2=0x7f8a941f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a84034040 tx=0x7f8a84003820 comp rx=0 tx=0).stop 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 shutdown_connections 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a94162710 0x7f8a94152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a940cf840 0x7f8a941f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 --2- 172.21.15.164:0/2463330874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a9406d2b0 0x7f8a941f6580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.423+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 >> 172.21.15.164:0/2463330874 conn(0x7f8a940d1960 msgr2=0x7f8a940d2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.424+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 shutdown_connections 2024-09-17T03:13:09.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.424+0000 7f8a99400640 1 -- 172.21.15.164:0/2463330874 wait complete. 2024-09-17T03:13:09.447 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2ab5aef1-e1bf-455e-ae05-2198296e3f94 2 2024-09-17T03:13:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 -- 172.21.15.164:0/4181611640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f006d2b0 msgr2=0x7f65f01621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 --2- 172.21.15.164:0/4181611640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f006d2b0 0x7f65f01621d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f65f00cb030 tx=0x7f65e002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 -- 172.21.15.164:0/4181611640 shutdown_connections 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 --2- 172.21.15.164:0/4181611640 >> v2:172.21.15.164:3300/0 conn(0x7f65f00cf840 0x7f65f0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 --2- 172.21.15.164:0/4181611640 >> v2:172.21.15.153:3300/0 conn(0x7f65f0162710 0x7f65f00cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 --2- 172.21.15.164:0/4181611640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f006d2b0 0x7f65f01621d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 -- 172.21.15.164:0/4181611640 >> 172.21.15.164:0/4181611640 conn(0x7f65f00d1960 msgr2=0x7f65f00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 -- 172.21.15.164:0/4181611640 shutdown_connections 2024-09-17T03:13:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.666+0000 7f65f5800640 1 -- 172.21.15.164:0/4181611640 wait complete. 2024-09-17T03:13:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.668+0000 7f65f5800640 1 Processor -- start 2024-09-17T03:13:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.668+0000 7f65f5800640 1 -- start start 2024-09-17T03:13:09.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.669+0000 7f65f5800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65f006d2b0 0x7f65f00c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.669+0000 7f65f5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 0x7f65f01f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.669+0000 7f65f5800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f5800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0155770 con 0x7f65f006d2b0 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f5800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01555f0 con 0x7f65f00cf840 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f5800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f65f01558f0 con 0x7f65f0162710 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65ef400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 0x7f65f01f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:43906/0 (socket says 172.21.15.164:43906) 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 -- 172.21.15.164:0/2727057976 learned_addr learned my addr 172.21.15.164:0/2727057976 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65efe00640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65f006d2b0 0x7f65f00c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 -- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 msgr2=0x7f65f01f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 0x7f65f01f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 -- 172.21.15.164:0/2727057976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65f006d2b0 msgr2=0x7f65f00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65f006d2b0 0x7f65f00c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65f4e00640 1 -- 172.21.15.164:0/2727057976 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0156080 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.670+0000 7f65ef400640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 0x7f65f01f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65f4e00640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65e800ebb0 tx=0x7f65e800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003b70 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65e8003d10 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f0156360 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8004280 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f0156920 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65e8021440 con 0x7f65f0162710 2024-09-17T03:13:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.671+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f65e80047b0 con 0x7f65f0162710 2024-09-17T03:13:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.672+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f0154ea0 con 0x7f65f0162710 2024-09-17T03:13:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.674+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f65e8021730 con 0x7f65f0162710 2024-09-17T03:13:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.748+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ab5aef1-e1bf-455e-ae05-2198296e3f94", "id": 2} v 0) -- 0x7f65f006eef0 con 0x7f65f0162710 2024-09-17T03:13:09.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.752+0000 7f65e7e00640 1 -- 172.21.15.164:0/2727057976 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ab5aef1-e1bf-455e-ae05-2198296e3f94", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f65e8004b40 con 0x7f65f0162710 2024-09-17T03:13:09.750 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 msgr2=0x7f65f0157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65e800ebb0 tx=0x7f65e800c6a0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 shutdown_connections 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65f0162710 0x7f65f0157120 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f00cf840 0x7f65f01f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 --2- 172.21.15.164:0/2727057976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65f006d2b0 0x7f65f00c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 >> 172.21.15.164:0/2727057976 conn(0x7f65f00d1960 msgr2=0x7f65f00cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.753+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 shutdown_connections 2024-09-17T03:13:09.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.754+0000 7f65f5800640 1 -- 172.21.15.164:0/2727057976 wait complete. 2024-09-17T03:13:09.774 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 44103905-4c48-4f5e-9e09-a9822c02d7b2 3 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 -- 172.21.15.164:0/3517758472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c40d3420 msgr2=0x7f75c40d3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 --2- 172.21.15.164:0/3517758472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c40d3420 0x7f75c40d3830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75b0005fd0 tx=0x7f75b002a560 comp rx=0 tx=0).stop 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 -- 172.21.15.164:0/3517758472 shutdown_connections 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 --2- 172.21.15.164:0/3517758472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c40d3420 0x7f75c40d3830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 -- 172.21.15.164:0/3517758472 >> 172.21.15.164:0/3517758472 conn(0x7f75c40d1980 msgr2=0x7f75c40d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 -- 172.21.15.164:0/3517758472 shutdown_connections 2024-09-17T03:13:09.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.995+0000 7f75cac00640 1 -- 172.21.15.164:0/3517758472 wait complete. 2024-09-17T03:13:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.999+0000 7f75cac00640 1 Processor -- start 2024-09-17T03:13:09.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:09.999+0000 7f75cac00640 1 -- start start 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 0x7f75c40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 0x7f75c40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75c41620c0 0x7f75c40b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75c406e0a0 con 0x7f75c40d3420 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f75c406df20 con 0x7f75c415e4d0 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75cac00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f75c406e220 con 0x7f75c41620c0 2024-09-17T03:13:10.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75c8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 0x7f75c40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75c8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 0x7f75c40cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41342/0 (socket says 172.21.15.164:41342) 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75c8e00640 1 -- 172.21.15.164:0/276289082 learned_addr learned my addr 172.21.15.164:0/276289082 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75c9800640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 0x7f75c40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.002+0000 7f75ca200640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75c41620c0 0x7f75c40b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 -- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75c41620c0 msgr2=0x7f75c40b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75c41620c0 0x7f75c40b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 -- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 msgr2=0x7f75c40cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 0x7f75c40cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 -- 172.21.15.164:0/276289082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c40c9dc0 con 0x7f75c40d3420 2024-09-17T03:13:10.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c9800640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 0x7f75c40cd4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c3f0 tx=0x7f75b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:10.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8017070 con 0x7f75c40d3420 2024-09-17T03:13:10.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75b80053c0 con 0x7f75c40d3420 2024-09-17T03:13:10.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8003850 con 0x7f75c40d3420 2024-09-17T03:13:10.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.003+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c40c9000 con 0x7f75c40d3420 2024-09-17T03:13:10.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.004+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c40c95c0 con 0x7f75c40d3420 2024-09-17T03:13:10.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.004+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f75b801a070 con 0x7f75c40d3420 2024-09-17T03:13:10.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.004+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f75b8011590 con 0x7f75c40d3420 2024-09-17T03:13:10.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.005+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c40d3830 con 0x7f75c40d3420 2024-09-17T03:13:10.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.007+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f75b8021070 con 0x7f75c40d3420 2024-09-17T03:13:10.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.081+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44103905-4c48-4f5e-9e09-a9822c02d7b2", "id": 3} v 0) -- 0x7f75c415dd10 con 0x7f75c40d3420 2024-09-17T03:13:10.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.084+0000 7f75c1600640 1 -- 172.21.15.164:0/276289082 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44103905-4c48-4f5e-9e09-a9822c02d7b2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f75c4162ea0 con 0x7f75c40d3420 2024-09-17T03:13:10.082 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 msgr2=0x7f75c40cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 0x7f75c40cd4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c3f0 tx=0x7f75b800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 shutdown_connections 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f75c41620c0 0x7f75c40b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f75c415e4d0 0x7f75c40cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 --2- 172.21.15.164:0/276289082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75c40d3420 0x7f75c40cd4f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.085+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 >> 172.21.15.164:0/276289082 conn(0x7f75c40d1980 msgr2=0x7f75c40b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.086+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 shutdown_connections 2024-09-17T03:13:10.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.086+0000 7f75cac00640 1 -- 172.21.15.164:0/276289082 wait complete. 2024-09-17T03:13:10.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2c785618-b3cc-4716-baaf-2785fb0bcbf3 4 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 -- 172.21.15.164:0/4223874745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8901628e0 msgr2=0x7fa8900cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 --2- 172.21.15.164:0/4223874745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8901628e0 0x7fa8900cf300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa8900d0070 tx=0x7fa88002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 -- 172.21.15.164:0/4223874745 shutdown_connections 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 --2- 172.21.15.164:0/4223874745 >> v2:172.21.15.153:3300/0 conn(0x7fa8900cf840 0x7fa890154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 --2- 172.21.15.164:0/4223874745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8901628e0 0x7fa8900cf300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 -- 172.21.15.164:0/4223874745 >> 172.21.15.164:0/4223874745 conn(0x7fa8900d1960 msgr2=0x7fa8900d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 -- 172.21.15.164:0/4223874745 shutdown_connections 2024-09-17T03:13:10.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.325+0000 7fa897200640 1 -- 172.21.15.164:0/4223874745 wait complete. 2024-09-17T03:13:10.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.328+0000 7fa897200640 1 Processor -- start 2024-09-17T03:13:10.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.328+0000 7fa897200640 1 -- start start 2024-09-17T03:13:10.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 0x7fa890150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 0x7fa890161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa890151a10 0x7fa890161a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa890155820 con 0x7fa890151a10 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa8901556a0 con 0x7fa8900cf840 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa897200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa8901559a0 con 0x7fa89006d2b0 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa895e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 0x7fa890150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa895400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 0x7fa890161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.329+0000 7fa895e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 0x7fa890150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:43926/0 (socket says 172.21.15.164:43926) 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895e00640 1 -- 172.21.15.164:0/634646428 learned_addr learned my addr 172.21.15.164:0/634646428 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa896800640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa890151a10 0x7fa890161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 -- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 msgr2=0x7fa890150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 0x7fa890150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 -- 172.21.15.164:0/634646428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa890151a10 msgr2=0x7fa890161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa890151a10 0x7fa890161a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 -- 172.21.15.164:0/634646428 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8901f9440 con 0x7fa8900cf840 2024-09-17T03:13:10.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.330+0000 7fa895400640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 0x7fa890161550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa89006e260 tx=0x7fa8800038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:10.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88003e030 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa880003d90 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8901f96d0 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880035040 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8900cd570 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa880041030 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.331+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa880004d90 con 0x7fa8900cf840 2024-09-17T03:13:10.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.332+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa890154ea0 con 0x7fa8900cf840 2024-09-17T03:13:10.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.334+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa880043410 con 0x7fa8900cf840 2024-09-17T03:13:10.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.408+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c785618-b3cc-4716-baaf-2785fb0bcbf3", "id": 4} v 0) -- 0x7fa89015e740 con 0x7fa8900cf840 2024-09-17T03:13:10.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.412+0000 7fa88a000640 1 -- 172.21.15.164:0/634646428 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c785618-b3cc-4716-baaf-2785fb0bcbf3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa880004fb0 con 0x7fa8900cf840 2024-09-17T03:13:10.411 INFO:teuthology.orchestra.run.smithi164.stdout:4 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.413+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 msgr2=0x7fa890161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.413+0000 7fa897200640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 0x7fa890161550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa89006e260 tx=0x7fa8800038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 shutdown_connections 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa890151a10 0x7fa890161a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8900cf840 0x7fa890161550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 --2- 172.21.15.164:0/634646428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa89006d2b0 0x7fa890150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 >> 172.21.15.164:0/634646428 conn(0x7fa8900d1960 msgr2=0x7fa890162160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 shutdown_connections 2024-09-17T03:13:10.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.414+0000 7fa897200640 1 -- 172.21.15.164:0/634646428 wait complete. 2024-09-17T03:13:10.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new fe974c58-81a1-4b15-9a83-38770a81151c 5 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 -- 172.21.15.164:0/2170653997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 msgr2=0x7f697c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 --2- 172.21.15.164:0/2170653997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c0cefa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f697402aa10 comp rx=0 tx=0).stop 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 -- 172.21.15.164:0/2170653997 shutdown_connections 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 --2- 172.21.15.164:0/2170653997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c0cefa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 --2- 172.21.15.164:0/2170653997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 -- 172.21.15.164:0/2170653997 >> 172.21.15.164:0/2170653997 conn(0x7f697c09d830 msgr2=0x7f697c0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 -- 172.21.15.164:0/2170653997 shutdown_connections 2024-09-17T03:13:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.654+0000 7f6981800640 1 -- 172.21.15.164:0/2170653997 wait complete. 2024-09-17T03:13:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.656+0000 7f6981800640 1 Processor -- start 2024-09-17T03:13:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.657+0000 7f6981800640 1 -- start start 2024-09-17T03:13:10.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c1f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f697c0b6700 con 0x7f697c0b9ad0 2024-09-17T03:13:10.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f697c0b6580 con 0x7f697c0ceb90 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f6981800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0b6880 con 0x7f697c15ee80 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f697a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c1f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f697aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f697b400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f697aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.164:34844/0 (socket says 172.21.15.164:34844) 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.658+0000 7f697aa00640 1 -- 172.21.15.164:0/951425149 learned_addr learned my addr 172.21.15.164:0/951425149 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 -- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 msgr2=0x7f697c158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 -- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 msgr2=0x7f697c1f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c1f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 -- 172.21.15.164:0/951425149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c1f6700 con 0x7f697c0b9ad0 2024-09-17T03:13:10.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697a000640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c1f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697b400640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.659+0000 7f697aa00640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e790 tx=0x7f696c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00eea0 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f696c00cdb0 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c010690 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c0a0110 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c1f60e0 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f696c010830 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.660+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f696c018c40 con 0x7f697c0b9ad0 2024-09-17T03:13:10.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.661+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c0b6da0 con 0x7f697c0b9ad0 2024-09-17T03:13:10.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.663+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f696c010b20 con 0x7f697c0b9ad0 2024-09-17T03:13:10.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.737+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe974c58-81a1-4b15-9a83-38770a81151c", "id": 5} v 0) -- 0x7f697c0d4ee0 con 0x7f697c0b9ad0 2024-09-17T03:13:10.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.739+0000 7f6972a00640 1 -- 172.21.15.164:0/951425149 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe974c58-81a1-4b15-9a83-38770a81151c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f696c010d00 con 0x7f697c0b9ad0 2024-09-17T03:13:10.738 INFO:teuthology.orchestra.run.smithi164.stdout:5 2024-09-17T03:13:10.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 msgr2=0x7f697c06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e790 tx=0x7f696c00ec50 comp rx=0 tx=0).stop 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 shutdown_connections 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f697c15ee80 0x7f697c158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c0ceb90 0x7f697c1f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 --2- 172.21.15.164:0/951425149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697c0b9ad0 0x7f697c06f890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 >> 172.21.15.164:0/951425149 conn(0x7f697c09d830 msgr2=0x7f697c15ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 shutdown_connections 2024-09-17T03:13:10.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.741+0000 7f6981800640 1 -- 172.21.15.164:0/951425149 wait complete. 2024-09-17T03:13:10.762 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new f644f925-1568-4cc3-8358-9be1f4b5b8c0 6 2024-09-17T03:13:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 -- 172.21.15.164:0/902483723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 msgr2=0x7f725806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 --2- 172.21.15.164:0/902483723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f725806ddf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f72580d10e0 tx=0x7f724802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 -- 172.21.15.164:0/902483723 shutdown_connections 2024-09-17T03:13:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 --2- 172.21.15.164:0/902483723 >> v2:172.21.15.153:3300/0 conn(0x7f725806e330 0x7f72580cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 --2- 172.21.15.164:0/902483723 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f725806ddf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.996+0000 7f725fc00640 1 -- 172.21.15.164:0/902483723 >> 172.21.15.164:0/902483723 conn(0x7f72580b1b90 msgr2=0x7f72580b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.997+0000 7f725fc00640 1 -- 172.21.15.164:0/902483723 shutdown_connections 2024-09-17T03:13:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.997+0000 7f725fc00640 1 -- 172.21.15.164:0/902483723 wait complete. 2024-09-17T03:13:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.999+0000 7f725fc00640 1 Processor -- start 2024-09-17T03:13:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:10.999+0000 7f725fc00640 1 -- start start 2024-09-17T03:13:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f725806e330 0x7f725815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f72580c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7258070ba0 con 0x7f72580cf7d0 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f72580ca9f0 con 0x7f725815fc50 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.000+0000 7f725fc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7258070d20 con 0x7f725806e330 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f725d200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f725806e330 0x7f725815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.164:59758/0 (socket says 172.21.15.164:59758) 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f725dc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f72580c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 -- 172.21.15.164:0/1582985139 learned_addr learned my addr 172.21.15.164:0/1582985139 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 -- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f725806e330 msgr2=0x7f725815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f725806e330 0x7f725815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 -- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 msgr2=0x7f72580c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f72580c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 -- 172.21.15.164:0/1582985139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72580c9b40 con 0x7f72580cf7d0 2024-09-17T03:13:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7257e00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f724400e790 tx=0x7f724400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.001+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724400eea0 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.002+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f724400ccc0 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.002+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72580c9e20 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.002+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7244005280 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.002+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72580ca3e0 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.003+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7258073820 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.003+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f7244005420 con 0x7f72580cf7d0 2024-09-17T03:13:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.004+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7244052aa0 con 0x7f72580cf7d0 2024-09-17T03:13:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.006+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7244013c20 con 0x7f72580cf7d0 2024-09-17T03:13:11.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.077+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f644f925-1568-4cc3-8358-9be1f4b5b8c0", "id": 6} v 0) -- 0x7f72580c9860 con 0x7f72580cf7d0 2024-09-17T03:13:11.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f7254c00640 1 -- 172.21.15.164:0/1582985139 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f644f925-1568-4cc3-8358-9be1f4b5b8c0", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7244021440 con 0x7f72580cf7d0 2024-09-17T03:13:11.078 INFO:teuthology.orchestra.run.smithi164.stdout:6 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 msgr2=0x7f72580c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f724400e790 tx=0x7f724400ec50 comp rx=0 tx=0).stop 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 shutdown_connections 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f725815fc50 0x7f72580c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72580cf7d0 0x7f72580c9010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 --2- 172.21.15.164:0/1582985139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f725806e330 0x7f725815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.080+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 >> 172.21.15.164:0/1582985139 conn(0x7f72580b1b90 msgr2=0x7f72580b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.081+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 shutdown_connections 2024-09-17T03:13:11.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.081+0000 7f725fc00640 1 -- 172.21.15.164:0/1582985139 wait complete. 2024-09-17T03:13:11.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 70710980-e8cc-475e-8c6b-1be89b4dd4bf 7 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 -- 172.21.15.164:0/656296120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 msgr2=0x7f34f00b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 --2- 172.21.15.164:0/656296120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f00b4f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009830 tx=0x7f34e402a520 comp rx=0 tx=0).stop 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 -- 172.21.15.164:0/656296120 shutdown_connections 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 --2- 172.21.15.164:0/656296120 >> v2:172.21.15.164:3300/0 conn(0x7f34f00ccfc0 0x7f34f00cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 --2- 172.21.15.164:0/656296120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f00b4f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 -- 172.21.15.164:0/656296120 >> 172.21.15.164:0/656296120 conn(0x7f34f006f920 msgr2=0x7f34f00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 -- 172.21.15.164:0/656296120 shutdown_connections 2024-09-17T03:13:11.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.320+0000 7f34f6a00640 1 -- 172.21.15.164:0/656296120 wait complete. 2024-09-17T03:13:11.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.322+0000 7f34f6a00640 1 Processor -- start 2024-09-17T03:13:11.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.323+0000 7f34f6a00640 1 -- start start 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 0x7f34f00730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34f01f8a60 0x7f34f014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34f006d510 con 0x7f34f01f8a60 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f34f006d390 con 0x7f34f0156c60 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f34f006d690 con 0x7f34f006e370 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f5600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f4c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 0x7f34f00730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f5600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:53762/0 (socket says 172.21.15.164:53762) 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f5600640 1 -- 172.21.15.164:0/3595571080 learned_addr learned my addr 172.21.15.164:0/3595571080 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.324+0000 7f34f6000640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34f01f8a60 0x7f34f014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 -- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 msgr2=0x7f34f00730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 0x7f34f00730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 -- 172.21.15.164:0/3595571080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34f01f8a60 msgr2=0x7f34f014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34f01f8a60 0x7f34f014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 -- 172.21.15.164:0/3595571080 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f01f9190 con 0x7f34f006e370 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f4c00640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 0x7f34f00730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f5600640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34e402ab10 tx=0x7f34e4033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4031d60 con 0x7f34f006e370 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34e4033e10 con 0x7f34f006e370 2024-09-17T03:13:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f01f9470 con 0x7f34f006e370 2024-09-17T03:13:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.325+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e40332b0 con 0x7f34f006e370 2024-09-17T03:13:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.326+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f014bf50 con 0x7f34f006e370 2024-09-17T03:13:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.327+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f34e4033450 con 0x7f34f006e370 2024-09-17T03:13:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.327+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f006dc20 con 0x7f34f006e370 2024-09-17T03:13:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.327+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f34e40735f0 con 0x7f34f006e370 2024-09-17T03:13:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.329+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f34e403f030 con 0x7f34f006e370 2024-09-17T03:13:11.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.400+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70710980-e8cc-475e-8c6b-1be89b4dd4bf", "id": 7} v 0) -- 0x7f34f01f54b0 con 0x7f34f006e370 2024-09-17T03:13:11.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.410+0000 7f34ed600640 1 -- 172.21.15.164:0/3595571080 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70710980-e8cc-475e-8c6b-1be89b4dd4bf", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f34e404c3f0 con 0x7f34f006e370 2024-09-17T03:13:11.409 INFO:teuthology.orchestra.run.smithi164.stdout:7 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 msgr2=0x7f34f014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f34e402ab10 tx=0x7f34e4033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 shutdown_connections 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34f01f8a60 0x7f34f014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34f0156c60 0x7f34f00730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 --2- 172.21.15.164:0/3595571080 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34f006e370 0x7f34f014f290 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 >> 172.21.15.164:0/3595571080 conn(0x7f34f006f920 msgr2=0x7f34f00cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.411+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 shutdown_connections 2024-09-17T03:13:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:13:11.412+0000 7f34f6a00640 1 -- 172.21.15.164:0/3595571080 wait complete. 2024-09-17T03:13:11.430 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T03:13:11.430 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T03:13:11.434 INFO:tasks.ceph.osd.0:Started 2024-09-17T03:13:11.434 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T03:13:11.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T03:13:11.438 INFO:tasks.ceph.osd.1:Started 2024-09-17T03:13:11.438 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T03:13:11.439 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T03:13:11.442 INFO:tasks.ceph.osd.2:Started 2024-09-17T03:13:11.443 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T03:13:11.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T03:13:11.447 INFO:tasks.ceph.osd.3:Started 2024-09-17T03:13:11.447 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T03:13:11.447 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T03:13:11.451 INFO:tasks.ceph.osd.4:Started 2024-09-17T03:13:11.451 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T03:13:11.451 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T03:13:11.455 INFO:tasks.ceph.osd.5:Started 2024-09-17T03:13:11.455 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T03:13:11.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T03:13:11.458 INFO:tasks.ceph.osd.6:Started 2024-09-17T03:13:11.459 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T03:13:11.459 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T03:13:11.462 INFO:tasks.ceph.osd.7:Started 2024-09-17T03:13:11.463 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 -- 172.21.15.153:0/56444499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb006e330 msgr2=0x7f7bb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 --2- 172.21.15.153:0/56444499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb006e330 0x7f7bb006ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8005fd0 tx=0x7f7ba802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 -- 172.21.15.153:0/56444499 shutdown_connections 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 --2- 172.21.15.153:0/56444499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb006e330 0x7f7bb006ede0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 --2- 172.21.15.153:0/56444499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 -- 172.21.15.153:0/56444499 >> 172.21.15.153:0/56444499 conn(0x7f7bb00cca40 msgr2=0x7f7bb00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 -- 172.21.15.153:0/56444499 shutdown_connections 2024-09-17T03:13:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.762+0000 7f7bb7000640 1 -- 172.21.15.153:0/56444499 wait complete. 2024-09-17T03:13:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.764+0000 7f7bb7000640 1 Processor -- start 2024-09-17T03:13:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.765+0000 7f7bb7000640 1 -- start start 2024-09-17T03:13:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 0x7f7bb00b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb006f4a0 con 0x7f7bb0074cb0 2024-09-17T03:13:11.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb006f320 con 0x7f7bb006e330 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb7000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb006f620 con 0x7f7bb0073dd0 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57808/0 (socket says 172.21.15.153:57808) 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bb5000640 1 -- 172.21.15.153:0/1294375420 learned_addr learned my addr 172.21.15.153:0/1294375420 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7ba7400640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.766+0000 7f7bafe00640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 0x7f7bb00b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 -- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 msgr2=0x7f7bb00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb00c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 -- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 msgr2=0x7f7bb00b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 0x7f7bb00b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 -- 172.21.15.153:0/1294375420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb00c84b0 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7ba7400640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bafe00640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 0x7f7bb00b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb5000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ba802aea0 tx=0x7f7ba80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8031990 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba8031c20 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8033070 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.767+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb00c8790 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.768+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb00c8d50 con 0x7f7bb0074cb0 2024-09-17T03:13:11.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.768+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb00c8220 con 0x7f7bb0074cb0 2024-09-17T03:13:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.769+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f7ba8033210 con 0x7f7bb0074cb0 2024-09-17T03:13:11.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.769+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7ba8073510 con 0x7f7bb0074cb0 2024-09-17T03:13:11.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.771+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7ba804a030 con 0x7f7bb0074cb0 2024-09-17T03:13:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.814+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7f7ba80043c0 con 0x7f7bb0074cb0 2024-09-17T03:13:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.815+0000 7f7bacc00640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 0x7f7b8c07b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:11.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.815+0000 7f7bafe00640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 0x7f7b8c07b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.816+0000 7f7bafe00640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 0x7f7b8c07b300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0000f60 tx=0x7f7ba0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:11.822 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-17T03:13:11.824+0000 7f5e57800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T03:13:11.822 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-17T03:13:11.824+0000 7f5e57800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T03:13:11.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.835+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bb006fb60 con 0x7f7bb0074cb0 2024-09-17T03:13:11.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.836+0000 7f7bacc00640 1 -- 172.21.15.153:0/1294375420 <== mon.0 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7ba803f030 con 0x7f7bb0074cb0 2024-09-17T03:13:11.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:11.836 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:11.401950+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 msgr2=0x7f7b8c07b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 0x7f7b8c07b300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0000f60 tx=0x7f7ba0009040 comp rx=0 tx=0).stop 2024-09-17T03:13:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 msgr2=0x7f7bb00b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ba802aea0 tx=0x7f7ba80316d0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 shutdown_connections 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7b8c078ee0 0x7f7b8c07b300 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb0074cb0 0x7f7bb00b1370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb0073dd0 0x7f7bb00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 --2- 172.21.15.153:0/1294375420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb006e330 0x7f7bb00b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 >> 172.21.15.153:0/1294375420 conn(0x7f7bb00cca40 msgr2=0x7f7bb0159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 shutdown_connections 2024-09-17T03:13:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:11.837+0000 7f7bb7000640 1 -- 172.21.15.153:0/1294375420 wait complete. 2024-09-17T03:13:11.860 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T03:13:11.860 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T03:13:12.552 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-17T03:13:12.554+0000 7f9c03da2640 -1 Falling back to public interface 2024-09-17T03:13:12.666 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 -- 172.21.15.153:0/3583660951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc141566f0 msgr2=0x7fbc14156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 --2- 172.21.15.153:0/3583660951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc141566f0 0x7fbc14156b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005fd0 tx=0x7fbc0002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 -- 172.21.15.153:0/3583660951 shutdown_connections 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 --2- 172.21.15.153:0/3583660951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc141566f0 0x7fbc14156b00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 --2- 172.21.15.153:0/3583660951 >> v2:172.21.15.164:3300/0 conn(0x7fbc140cba70 0x7fbc1415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.870+0000 7fbc13200640 1 -- 172.21.15.153:0/3583660951 >> 172.21.15.153:0/3583660951 conn(0x7fbc140cd570 msgr2=0x7fbc140cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.871+0000 7fbc13200640 1 -- 172.21.15.153:0/3583660951 shutdown_connections 2024-09-17T03:13:12.871 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.871+0000 7fbc13200640 1 -- 172.21.15.153:0/3583660951 wait complete. 2024-09-17T03:13:12.872 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.873+0000 7fbc13200640 1 Processor -- start 2024-09-17T03:13:12.873 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.873+0000 7fbc13200640 1 -- start start 2024-09-17T03:13:12.875 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc1406fca0 0x7fbc1415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:12.875 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc140cba70 0x7fbc14149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140afbe0 con 0x7fbc141566f0 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140afa60 con 0x7fbc1406fca0 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.874+0000 7fbc13200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbc140afd60 con 0x7fbc140cba70 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57818/0 (socket says 172.21.15.153:57818) 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 -- 172.21.15.153:0/4261643194 learned_addr learned my addr 172.21.15.153:0/4261643194 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc11400640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc140cba70 0x7fbc14149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc11e00640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc1406fca0 0x7fbc1415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 -- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc140cba70 msgr2=0x7fbc14149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc140cba70 0x7fbc14149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 -- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc1406fca0 msgr2=0x7fbc1415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:12.876 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc1406fca0 0x7fbc1415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 -- 172.21.15.153:0/4261643194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1414a0e0 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc12800640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c6c0 tx=0x7fbc0c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.875+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c003b70 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.876+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc0c003d10 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.876+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc14157410 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.876+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c005330 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.876+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc141579d0 con 0x7fbc141566f0 2024-09-17T03:13:12.877 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.877+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14068ea0 con 0x7fbc141566f0 2024-09-17T03:13:12.878 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.878+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fbc0c0054d0 con 0x7fbc141566f0 2024-09-17T03:13:12.879 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.879+0000 7fbc0a000640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 0x7fbbf407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:12.879 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.879+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbc0c099940 con 0x7fbc141566f0 2024-09-17T03:13:12.879 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.879+0000 7fbc11e00640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 0x7fbbf407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:12.880 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.880+0000 7fbc11e00640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 0x7fbbf407b010 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009b30 tx=0x7fbc04005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:12.883 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:12.884+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc0c062750 con 0x7fbc141566f0 2024-09-17T03:13:13.027 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-17T03:13:13.029+0000 7f76c005e640 -1 Falling back to public interface 2024-09-17T03:13:13.072 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.072+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc141571a0 con 0x7fbc141566f0 2024-09-17T03:13:13.073 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.073+0000 7fbc0a000640 1 -- 172.21.15.153:0/4261643194 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbc0c067180 con 0x7fbc141566f0 2024-09-17T03:13:13.073 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-17T03:13:13.074 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:11.401950+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:13.076 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 msgr2=0x7fbbf407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:13.076 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 0x7fbbf407b010 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009b30 tx=0x7fbc04005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:13.076 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 msgr2=0x7fbc14149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:13.076 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c6c0 tx=0x7fbc0c00cb80 comp rx=0 tx=0).stop 2024-09-17T03:13:13.076 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 shutdown_connections 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbbf4078b00 0x7fbbf407b010 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc141566f0 0x7fbc14149ba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc140cba70 0x7fbc14149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 --2- 172.21.15.153:0/4261643194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc1406fca0 0x7fbc1415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 >> 172.21.15.153:0/4261643194 conn(0x7fbc140cd570 msgr2=0x7fbc140b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 shutdown_connections 2024-09-17T03:13:13.077 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:13.076+0000 7fbc13200640 1 -- 172.21.15.153:0/4261643194 wait complete. 2024-09-17T03:13:13.081 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-17T03:13:13.083+0000 7f620f20f640 -1 Falling back to public interface 2024-09-17T03:13:13.086 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-17T03:13:13.087+0000 7f697160b640 -1 Falling back to public interface 2024-09-17T03:13:13.094 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T03:13:13.115 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-17T03:13:13.115+0000 7fc25f4da640 -1 Falling back to public interface 2024-09-17T03:13:13.173 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T03:13:13.173+0000 7f7abd345640 -1 Falling back to public interface 2024-09-17T03:13:13.305 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-17T03:13:13.301+0000 7f35bdf89640 -1 Falling back to public interface 2024-09-17T03:13:13.306 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-17T03:13:13.307+0000 7efcbf444640 -1 Falling back to public interface 2024-09-17T03:13:16.482 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-17T03:13:16.484+0000 7f9c03da2640 -1 osd.6 0 log_to_monitors true 2024-09-17T03:13:16.766 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-17T03:13:16.767+0000 7f697160b640 -1 osd.2 0 log_to_monitors true 2024-09-17T03:13:17.039 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-17T03:13:17.041+0000 7f76c005e640 -1 osd.4 0 log_to_monitors true 2024-09-17T03:13:17.046 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-17T03:13:17.047+0000 7fc25f4da640 -1 osd.3 0 log_to_monitors true 2024-09-17T03:13:17.265 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-17T03:13:17.267+0000 7f620f20f640 -1 osd.7 0 log_to_monitors true 2024-09-17T03:13:17.266 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-17T03:13:17.268+0000 7efcbf444640 -1 osd.5 0 log_to_monitors true 2024-09-17T03:13:17.447 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-17T03:13:17.448+0000 7f35bdf89640 -1 osd.0 0 log_to_monitors true 2024-09-17T03:13:17.628 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T03:13:17.629+0000 7f7abd345640 -1 osd.1 0 log_to_monitors true 2024-09-17T03:13:18.493 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-17T03:13:18.495+0000 7f9bfec00640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T03:13:18.503 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-17T03:13:18.505+0000 7f9bf4c00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:19.901 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:20.200 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 -- 172.21.15.153:0/622570926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768006310 msgr2=0x7f9768031670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.200 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 --2- 172.21.15.153:0/622570926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768006310 0x7f9768031670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f977006c0e0 tx=0x7f97700a62f0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 -- 172.21.15.153:0/622570926 shutdown_connections 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 --2- 172.21.15.153:0/622570926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768006310 0x7f9768031670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 --2- 172.21.15.153:0/622570926 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9768035cd0 0x7f97680e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 -- 172.21.15.153:0/622570926 >> 172.21.15.153:0/622570926 conn(0x7f976801d9a0 msgr2=0x7f9768039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 -- 172.21.15.153:0/622570926 shutdown_connections 2024-09-17T03:13:20.201 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.201+0000 7f976f200640 1 -- 172.21.15.153:0/622570926 wait complete. 2024-09-17T03:13:20.202 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.203+0000 7f976f200640 1 Processor -- start 2024-09-17T03:13:20.202 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.204+0000 7f976f200640 1 -- start start 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 0x7f976801fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 0x7f97680dec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 0x7f97680e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97680320d0 con 0x7f9768006310 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9768031f50 con 0x7f9768035cd0 2024-09-17T03:13:20.205 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.206+0000 7f976f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9768032250 con 0x7f97680072e0 2024-09-17T03:13:20.206 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.207+0000 7f976e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 0x7f97680e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.207+0000 7f976e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 0x7f97680e14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:48278/0 (socket says 172.21.15.153:48278) 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.207+0000 7f976e800640 1 -- 172.21.15.153:0/3378930162 learned_addr learned my addr 172.21.15.153:0/3378930162 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.207+0000 7f976de00640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 0x7f976801fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.207+0000 7f976d400640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 0x7f97680dec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 -- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 msgr2=0x7f97680e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 0x7f97680e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 -- 172.21.15.153:0/3378930162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 msgr2=0x7f976801fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.208 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 0x7f976801fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.209 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 -- 172.21.15.153:0/3378930162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97680e3b40 con 0x7f97680072e0 2024-09-17T03:13:20.209 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976de00640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 0x7f976801fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:20.209 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.209+0000 7f976d400640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 0x7f97680dec90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975c00e700 tx=0x7f975c00ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.210 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.211+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c00cab0 con 0x7f97680072e0 2024-09-17T03:13:20.210 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.211+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f975c00cd40 con 0x7f97680072e0 2024-09-17T03:13:20.210 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.211+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c010690 con 0x7f97680072e0 2024-09-17T03:13:20.210 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.211+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976801ef50 con 0x7f97680072e0 2024-09-17T03:13:20.210 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.211+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f976801f510 con 0x7f97680072e0 2024-09-17T03:13:20.214 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.212+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97680e38b0 con 0x7f97680072e0 2024-09-17T03:13:20.214 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.215+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f975c010830 con 0x7f97680072e0 2024-09-17T03:13:20.216 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.217+0000 7f9766000640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 0x7f975007b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.216 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.217+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f975c09aba0 con 0x7f97680072e0 2024-09-17T03:13:20.217 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.218+0000 7f976de00640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 0x7f975007b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.218 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.219+0000 7f976de00640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 0x7f975007b010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9760000fb0 tx=0x7f9760007e90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.223 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.223+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f975c03ee20 con 0x7f97680072e0 2024-09-17T03:13:20.439 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-17T03:13:20.441+0000 7f6209a00640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T03:13:20.444 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-17T03:13:20.444+0000 7f76bb000640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T03:13:20.447 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-17T03:13:20.449+0000 7f76b1000640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:20.454 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-17T03:13:20.456+0000 7f61ffa00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:20.498 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-17T03:13:20.500+0000 7efcbac00640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T03:13:20.509 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-17T03:13:20.511+0000 7efcb0200640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:20.570 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.571+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9768032740 con 0x7f97680072e0 2024-09-17T03:13:20.571 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.572+0000 7f9766000640 1 -- 172.21.15.153:0/3378930162 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f975c063760 con 0x7f97680072e0 2024-09-17T03:13:20.573 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-17T03:13:20.573 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":14,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:19.548373+0000","last_up_change":"2024-09-17T03:13:18.544559+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:20.578 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 msgr2=0x7f975007b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 0x7f975007b010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9760000fb0 tx=0x7f9760007e90 comp rx=0 tx=0).stop 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 msgr2=0x7f97680dec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 0x7f97680dec90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975c00e700 tx=0x7f975c00ebc0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 shutdown_connections 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9750078b00 0x7f975007b010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768035cd0 0x7f97680e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97680072e0 0x7f97680dec90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.579 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 --2- 172.21.15.153:0/3378930162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768006310 0x7f976801fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.580 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 >> 172.21.15.153:0/3378930162 conn(0x7f976801d9a0 msgr2=0x7f9768032950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.580 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.579+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 shutdown_connections 2024-09-17T03:13:20.580 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:20.580+0000 7f976f200640 1 -- 172.21.15.153:0/3378930162 wait complete. 2024-09-17T03:13:20.616 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T03:13:20.759 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-17T03:13:20.761+0000 7f696be00640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T03:13:20.767 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-17T03:13:20.768+0000 7f6961e00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:20.768 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-17T03:13:20.770+0000 7f35b8e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T03:13:20.775 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-17T03:13:20.777+0000 7f35aee00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:20.822 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-17T03:13:20.824+0000 7fc25ae00640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T03:13:20.830 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-17T03:13:20.831+0000 7fc250400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:21.112 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T03:13:21.114+0000 7f7ab8c00640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T03:13:21.117 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-17T03:13:21.118+0000 7f7aae200640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:13:22.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:22.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:27.423 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 -- 172.21.15.153:0/286528766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387406e500 msgr2=0x7f38740cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 --2- 172.21.15.153:0/286528766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387406e500 0x7f38740cc020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f386c005fd0 tx=0x7f386c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 -- 172.21.15.153:0/286528766 shutdown_connections 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 --2- 172.21.15.153:0/286528766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387406e500 0x7f38740cc020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 --2- 172.21.15.153:0/286528766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3874074cb0 0x7f3874073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 -- 172.21.15.153:0/286528766 >> 172.21.15.153:0/286528766 conn(0x7f38740cca40 msgr2=0x7f38740cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 -- 172.21.15.153:0/286528766 shutdown_connections 2024-09-17T03:13:27.635 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.635+0000 7f387b600640 1 -- 172.21.15.153:0/286528766 wait complete. 2024-09-17T03:13:27.636 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.638+0000 7f387b600640 1 Processor -- start 2024-09-17T03:13:27.636 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.638+0000 7f387b600640 1 -- start start 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 0x7f38741542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38740cbc10 0x7f38741e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f387406f310 con 0x7f38740ce7d0 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f387406f190 con 0x7f3874074cb0 2024-09-17T03:13:27.640 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.639+0000 7f387b600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f387406f490 con 0x7f38740cbc10 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38254/0 (socket says 172.21.15.153:38254) 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 -- 172.21.15.153:0/375731895 learned_addr learned my addr 172.21.15.153:0/375731895 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3873e00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38740cbc10 0x7f38741e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3878c00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 0x7f38741542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 -- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38740cbc10 msgr2=0x7f38741e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38740cbc10 0x7f38741e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 -- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 msgr2=0x7f38741542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 0x7f38741542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 -- 172.21.15.153:0/375731895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38740cdd30 con 0x7f38740ce7d0 2024-09-17T03:13:27.641 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3878c00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 0x7f38741542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3879600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f386c009bf0 tx=0x7f386c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.640+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c044070 con 0x7f38740ce7d0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.641+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38741e6f50 con 0x7f38740ce7d0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.641+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f386c003e00 con 0x7f38740ce7d0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.641+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0044b0 con 0x7f38740ce7d0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.641+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38740cdfd0 con 0x7f38740ce7d0 2024-09-17T03:13:27.642 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.642+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387406f9b0 con 0x7f38740ce7d0 2024-09-17T03:13:27.643 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.644+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f386c047070 con 0x7f38740ce7d0 2024-09-17T03:13:27.644 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.645+0000 7f3870c00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 0x7f385407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.644 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.645+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f386c0bbb30 con 0x7f38740ce7d0 2024-09-17T03:13:27.645 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.646+0000 7f3878c00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 0x7f385407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.645 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.646+0000 7f3878c00640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 0x7f385407b010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f387415a730 tx=0x7f3868005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.648 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.649+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f386c04e080 con 0x7f38740ce7d0 2024-09-17T03:13:27.816 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.817+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f386c07fe70 con 0x7f38740ce7d0 2024-09-17T03:13:27.835 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.836+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38741e6730 con 0x7f38740ce7d0 2024-09-17T03:13:27.836 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.837+0000 7f3870c00640 1 -- 172.21.15.153:0/375731895 <== mon.0 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7f386c032030 con 0x7f38740ce7d0 2024-09-17T03:13:27.836 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-17T03:13:27.837 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":19,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:25.801724+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.839+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 msgr2=0x7f385407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.839+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 0x7f385407b010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f387415a730 tx=0x7f3868005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 msgr2=0x7f38740a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f386c009bf0 tx=0x7f386c003c10 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 shutdown_connections 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3854078b00 0x7f385407b010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38740ce7d0 0x7f38740a00a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38740cbc10 0x7f38741e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 --2- 172.21.15.153:0/375731895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3874074cb0 0x7f38741542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.839 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 >> 172.21.15.153:0/375731895 conn(0x7f38740cca40 msgr2=0x7f38740b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.840 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 shutdown_connections 2024-09-17T03:13:27.840 INFO:teuthology.misc.health.smithi153.stderr:2024-09-17T03:13:27.840+0000 7f387b600640 1 -- 172.21.15.153:0/375731895 wait complete. 2024-09-17T03:13:27.857 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T03:13:27.857 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T03:13:27.858 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:13:27.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:13:27.862 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:13:27.862 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:13:27.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:13:27.866 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:13:27.866 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:13:27.866 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:13:27.870 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:13:27.870 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:13:27.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:13:27.874 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:13:27.874 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T03:13:27.875 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:28.059 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-09-17T03:13:28.059 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:13:28.065 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:13:28.066 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:13:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 -- 172.21.15.153:0/2653821052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600b9e40 msgr2=0x7faf601622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 --2- 172.21.15.153:0/2653821052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600b9e40 0x7faf601622b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf50005fd0 tx=0x7faf5002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 -- 172.21.15.153:0/2653821052 shutdown_connections 2024-09-17T03:13:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 --2- 172.21.15.153:0/2653821052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf6006d9c0 0x7faf60154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 --2- 172.21.15.153:0/2653821052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf600b9e40 0x7faf601622b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 -- 172.21.15.153:0/2653821052 >> 172.21.15.153:0/2653821052 conn(0x7faf600d1930 msgr2=0x7faf600d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 -- 172.21.15.153:0/2653821052 shutdown_connections 2024-09-17T03:13:28.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.112+0000 7faf5f200640 1 -- 172.21.15.153:0/2653821052 wait complete. 2024-09-17T03:13:28.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.114+0000 7faf5f200640 1 Processor -- start 2024-09-17T03:13:28.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.114+0000 7faf5f200640 1 -- start start 2024-09-17T03:13:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.115+0000 7faf5f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 0x7faf6015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf600b9e40 0x7faf6015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf60155770 con 0x7faf601627f0 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf601555f0 con 0x7faf6006d9c0 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf601558f0 con 0x7faf600b9e40 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38314/0 (socket says 172.21.15.153:38314) 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 -- 172.21.15.153:0/4294064175 learned_addr learned my addr 172.21.15.153:0/4294064175 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5de00640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 0x7faf6015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf55400640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf600b9e40 0x7faf6015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 -- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf600b9e40 msgr2=0x7faf6015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf600b9e40 0x7faf6015aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 -- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 msgr2=0x7faf6015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 0x7faf6015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5e800640 1 -- 172.21.15.153:0/4294064175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf60158fd0 con 0x7faf601627f0 2024-09-17T03:13:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.116+0000 7faf5de00640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 0x7faf6015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf5e800640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf5800ea80 tx=0x7faf5800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58004b20 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf58004ce0 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf600cc350 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58005280 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.117+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf600cb870 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.118+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf60154ea0 con 0x7faf601627f0 2024-09-17T03:13:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.119+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf58005420 con 0x7faf601627f0 2024-09-17T03:13:28.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.120+0000 7faf56a00640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 0x7faf3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.120+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7faf5809b590 con 0x7faf601627f0 2024-09-17T03:13:28.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.121+0000 7faf5de00640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 0x7faf3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.122+0000 7faf5de00640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 0x7faf3c07b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf50033000 tx=0x7faf50004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.125+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf580636d0 con 0x7faf601627f0 2024-09-17T03:13:28.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.344+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf60153ce0 con 0x7faf601627f0 2024-09-17T03:13:28.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.345+0000 7faf56a00640 1 -- 172.21.15.153:0/4294064175 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7faf58068100 con 0x7faf601627f0 2024-09-17T03:13:28.344 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:28.344 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"btime":"2024-09-17T03:13:28:069016+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T03:13:28.344 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 2 2024-09-17T03:13:28.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 msgr2=0x7faf3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 0x7faf3c07b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf50033000 tx=0x7faf50004730 comp rx=0 tx=0).stop 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 msgr2=0x7faf60158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf5800ea80 tx=0x7faf5800ef40 comp rx=0 tx=0).stop 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 shutdown_connections 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf3c078b90 0x7faf3c07b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf601627f0 0x7faf60158a90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf600b9e40 0x7faf6015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 --2- 172.21.15.153:0/4294064175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf6006d9c0 0x7faf6015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.347+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 >> 172.21.15.153:0/4294064175 conn(0x7faf600d1930 msgr2=0x7faf6015d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.348+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 shutdown_connections 2024-09-17T03:13:28.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:28.348+0000 7faf5f200640 1 -- 172.21.15.153:0/4294064175 wait complete. 2024-09-17T03:13:30.370 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 -- 172.21.15.153:0/3928057244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49406d9c0 msgr2=0x7fa494154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 --2- 172.21.15.153:0/3928057244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49406d9c0 0x7fa494154ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b6de0 tx=0x7fa48c02a560 comp rx=0 tx=0).stop 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 -- 172.21.15.153:0/3928057244 shutdown_connections 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 --2- 172.21.15.153:0/3928057244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa49406d9c0 0x7fa494154ea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 --2- 172.21.15.153:0/3928057244 >> v2:172.21.15.164:3300/0 conn(0x7fa4940b9e40 0x7fa4941622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 -- 172.21.15.153:0/3928057244 >> 172.21.15.153:0/3928057244 conn(0x7fa4940d1930 msgr2=0x7fa4940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 -- 172.21.15.153:0/3928057244 shutdown_connections 2024-09-17T03:13:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.603+0000 7fa493200640 1 -- 172.21.15.153:0/3928057244 wait complete. 2024-09-17T03:13:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.605+0000 7fa493200640 1 Processor -- start 2024-09-17T03:13:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.605+0000 7fa493200640 1 -- start start 2024-09-17T03:13:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa49406d9c0 0x7fa494142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 0x7fa494160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa494155770 con 0x7fa4941627f0 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa4941555f0 con 0x7fa4940b9e40 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa493200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa4941558f0 con 0x7fa49406d9c0 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa492800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa492800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38328/0 (socket says 172.21.15.153:38328) 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa492800640 1 -- 172.21.15.153:0/1469818148 learned_addr learned my addr 172.21.15.153:0/1469818148 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa489400640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 0x7fa494160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.607+0000 7fa491e00640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa49406d9c0 0x7fa494142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 -- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa49406d9c0 msgr2=0x7fa494142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa49406d9c0 0x7fa494142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 -- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 msgr2=0x7fa494160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 0x7fa494160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 -- 172.21.15.153:0/1469818148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4941449c0 con 0x7fa4941627f0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa489400640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 0x7fa494160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa492800640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009230 tx=0x7fa48c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c03e030 con 0x7fa4941627f0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa48c003e50 con 0x7fa4941627f0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa494144e30 con 0x7fa4941627f0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.608+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c035040 con 0x7fa4941627f0 2024-09-17T03:13:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.609+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4941453f0 con 0x7fa4941627f0 2024-09-17T03:13:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.609+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494144b90 con 0x7fa4941627f0 2024-09-17T03:13:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.611+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa48c041030 con 0x7fa4941627f0 2024-09-17T03:13:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.612+0000 7fa48aa00640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 0x7fa47007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.612+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa48c0bb1f0 con 0x7fa4941627f0 2024-09-17T03:13:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.612+0000 7fa491e00640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 0x7fa47007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.613+0000 7fa491e00640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 0x7fa47007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa484005fd0 tx=0x7fa4840095e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.616+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa494144b90 con 0x7fa4941627f0 2024-09-17T03:13:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.835+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa494154ea0 con 0x7fa4941627f0 2024-09-17T03:13:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.836+0000 7fa48aa00640 1 -- 172.21.15.153:0/1469818148 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fa494163170 con 0x7fa4941627f0 2024-09-17T03:13:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:30.835 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"btime":"2024-09-17T03:13:29:070542+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4371,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T03:13:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 3 2024-09-17T03:13:30.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 msgr2=0x7fa47007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 0x7fa47007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa484005fd0 tx=0x7fa4840095e0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 msgr2=0x7fa4941614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009230 tx=0x7fa48c003960 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 shutdown_connections 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa470078b90 0x7fa47007b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4941627f0 0x7fa4941614d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4940b9e40 0x7fa494160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 --2- 172.21.15.153:0/1469818148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa49406d9c0 0x7fa494142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.838+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 >> 172.21.15.153:0/1469818148 conn(0x7fa4940d1930 msgr2=0x7fa494068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.839+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 shutdown_connections 2024-09-17T03:13:30.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:30.839+0000 7fa493200640 1 -- 172.21.15.153:0/1469818148 wait complete. 2024-09-17T03:13:30.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:13:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 -- 172.21.15.153:0/1090761427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 msgr2=0x7f4d88154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 --2- 172.21.15.153:0/1090761427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88154ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d80005fd0 tx=0x7f4d8002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 -- 172.21.15.153:0/1090761427 shutdown_connections 2024-09-17T03:13:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 --2- 172.21.15.153:0/1090761427 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88154ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 --2- 172.21.15.153:0/1090761427 >> v2:172.21.15.164:3300/0 conn(0x7f4d881629c0 0x7f4d8806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 -- 172.21.15.153:0/1090761427 >> 172.21.15.153:0/1090761427 conn(0x7f4d880d1930 msgr2=0x7f4d880d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 -- 172.21.15.153:0/1090761427 shutdown_connections 2024-09-17T03:13:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.083+0000 7f4d8d800640 1 -- 172.21.15.153:0/1090761427 wait complete. 2024-09-17T03:13:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.085+0000 7f4d8d800640 1 Processor -- start 2024-09-17T03:13:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.085+0000 7f4d8d800640 1 -- start start 2024-09-17T03:13:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d880b9e40 0x7f4d881e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d881ea740 0x7f4d881f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88155770 con 0x7f4d881ea740 2024-09-17T03:13:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881555f0 con 0x7f4d880b9e40 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8d800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4d881558f0 con 0x7f4d8806d7f0 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d87e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d87400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d880b9e40 0x7f4d881e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d87e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:37724/0 (socket says 172.21.15.153:37724) 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d87e00640 1 -- 172.21.15.153:0/3166914119 learned_addr learned my addr 172.21.15.153:0/3166914119 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:31.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.087+0000 7f4d8ce00640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d881ea740 0x7f4d881f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 -- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d880b9e40 msgr2=0x7f4d881e93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d880b9e40 0x7f4d881e93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 -- 172.21.15.153:0/3166914119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d881ea740 msgr2=0x7f4d881f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d881ea740 0x7f4d881f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 -- 172.21.15.153:0/3166914119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8815e0f0 con 0x7f4d8806d7f0 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d87e00640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c730 tx=0x7f4d7800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78016020 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d7800a950 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d881e8340 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.088+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800ada0 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.089+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d881e8620 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.090+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d88154ea0 con 0x7f4d8806d7f0 2024-09-17T03:13:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.091+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d78019020 con 0x7f4d8806d7f0 2024-09-17T03:13:31.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.092+0000 7f4d7fe00640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 0x7f4d6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.092+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4d7809a590 con 0x7f4d8806d7f0 2024-09-17T03:13:31.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.092+0000 7f4d87400640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 0x7f4d6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.093+0000 7f4d87400640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 0x7f4d6807b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d88161290 tx=0x7f4d74005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.098+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d78020030 con 0x7f4d8806d7f0 2024-09-17T03:13:31.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.281+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d880b8770 con 0x7f4d8806d7f0 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.282+0000 7f4d7fe00640 1 -- 172.21.15.153:0/3166914119 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f4d88163170 con 0x7f4d8806d7f0 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-09-17T03:13:31.282 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-09-17T03:13:31.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:13:31.283 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 msgr2=0x7f4d6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 0x7f4d6807b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d88161290 tx=0x7f4d74005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 msgr2=0x7f4d88155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c730 tx=0x7f4d7800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 shutdown_connections 2024-09-17T03:13:31.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d68078b90 0x7f4d6807b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d881ea740 0x7f4d881f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d880b9e40 0x7f4d881e93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 --2- 172.21.15.153:0/3166914119 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d8806d7f0 0x7f4d88155cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 >> 172.21.15.153:0/3166914119 conn(0x7f4d880d1930 msgr2=0x7f4d881531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 shutdown_connections 2024-09-17T03:13:31.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.285+0000 7f4d8d800640 1 -- 172.21.15.153:0/3166914119 wait complete. 2024-09-17T03:13:31.305 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:13:31.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 -- 172.21.15.153:0/529211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064003a00 msgr2=0x7f8064003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 --2- 172.21.15.153:0/529211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064003a00 0x7f8064003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8070001740 tx=0x7f8064005830 comp rx=0 tx=0).stop 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 -- 172.21.15.153:0/529211256 shutdown_connections 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 --2- 172.21.15.153:0/529211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064003a00 0x7f8064003e30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 -- 172.21.15.153:0/529211256 >> 172.21.15.153:0/529211256 conn(0x7f807c0ccac0 msgr2=0x7f807c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.531+0000 7f8084200640 1 -- 172.21.15.153:0/529211256 shutdown_connections 2024-09-17T03:13:31.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.532+0000 7f8084200640 1 -- 172.21.15.153:0/529211256 wait complete. 2024-09-17T03:13:31.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.534+0000 7f8084200640 1 Processor -- start 2024-09-17T03:13:31.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.534+0000 7f8084200640 1 -- start start 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 0x7f807c09bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f807c158130 0x7f807c158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f807c160490 con 0x7f807c1f8db0 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f807c160310 con 0x7f8064003a00 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.535+0000 7f8084200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f807c160610 con 0x7f807c158130 2024-09-17T03:13:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38358/0 (socket says 172.21.15.153:38358) 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 -- 172.21.15.153:0/44332018 learned_addr learned my addr 172.21.15.153:0/44332018 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8081800640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 0x7f807c09bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8082200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f807c158130 0x7f807c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 -- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f807c158130 msgr2=0x7f807c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f807c158130 0x7f807c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 -- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 msgr2=0x7f807c09bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 0x7f807c09bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 -- 172.21.15.153:0/44332018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c158a80 con 0x7f807c1f8db0 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8081800640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 0x7f807c09bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.536+0000 7f8080e00640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8068006630 tx=0x7f80680039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.537+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068015070 con 0x7f807c1f8db0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.537+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8068011920 con 0x7f807c1f8db0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.537+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068011d70 con 0x7f807c1f8db0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.537+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c09c750 con 0x7f807c1f8db0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.537+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c09cd10 con 0x7f807c1f8db0 2024-09-17T03:13:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.538+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c06f220 con 0x7f807c1f8db0 2024-09-17T03:13:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.539+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8068018070 con 0x7f807c1f8db0 2024-09-17T03:13:31.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.540+0000 7f8079600640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 0x7f805c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.540+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f806809b730 con 0x7f807c1f8db0 2024-09-17T03:13:31.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.541+0000 7f8081800640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 0x7f805c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.541+0000 7f8081800640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 0x7f805c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8070001710 tx=0x7f8070001270 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.545+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8068063e30 con 0x7f807c1f8db0 2024-09-17T03:13:31.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:31.731+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f807c09c4e0 con 0x7f807c1f8db0 2024-09-17T03:13:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.090+0000 7f8079600640 1 -- 172.21.15.153:0/44332018 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f8068063730 con 0x7f807c1f8db0 2024-09-17T03:13:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 msgr2=0x7f805c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 0x7f805c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8070001710 tx=0x7f8070001270 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 msgr2=0x7f807c1f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8068006630 tx=0x7f80680039c0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 shutdown_connections 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f805c078b90 0x7f805c07b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f807c158130 0x7f807c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f807c1f8db0 0x7f807c1f91c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 --2- 172.21.15.153:0/44332018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8064003a00 0x7f807c09bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.093+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 >> 172.21.15.153:0/44332018 conn(0x7f807c0ccac0 msgr2=0x7f807c072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.094+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 shutdown_connections 2024-09-17T03:13:32.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.094+0000 7f8084200640 1 -- 172.21.15.153:0/44332018 wait complete. 2024-09-17T03:13:32.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c40e00640 1 -- 172.21.15.153:0/1847717290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c20003fd0 msgr2=0x7f3c20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c40e00640 1 --2- 172.21.15.153:0/1847717290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c20003fd0 0x7f3c20004800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009b50 tx=0x7f3c20005830 comp rx=0 tx=0).stop 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c3a800640 1 -- 172.21.15.153:0/1847717290 reap_dead start 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c40e00640 1 -- 172.21.15.153:0/1847717290 shutdown_connections 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c40e00640 1 -- 172.21.15.153:0/1847717290 >> 172.21.15.153:0/1847717290 conn(0x7f3c3c0cca40 msgr2=0x7f3c3c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.354+0000 7f3c40e00640 1 -- 172.21.15.153:0/1847717290 shutdown_connections 2024-09-17T03:13:32.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.355+0000 7f3c40e00640 1 -- 172.21.15.153:0/1847717290 wait complete. 2024-09-17T03:13:32.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.357+0000 7f3c40e00640 1 Processor -- start 2024-09-17T03:13:32.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.357+0000 7f3c40e00640 1 -- start start 2024-09-17T03:13:32.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c20003fd0 0x7f3c3c1f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c3c0c9e20 0x7f3c3c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c06df70 con 0x7f3c3c14ad00 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c06ddf0 con 0x7f3c3c0c9e20 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.358+0000 7f3c40e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3c06e0f0 con 0x7f3c20003fd0 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38366/0 (socket says 172.21.15.153:38366) 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 -- 172.21.15.153:0/4180176558 learned_addr learned my addr 172.21.15.153:0/4180176558 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c39e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c20003fd0 0x7f3c3c1f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c3a800640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c3c0c9e20 0x7f3c3c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 -- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c20003fd0 msgr2=0x7f3c3c1f9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c20003fd0 0x7f3c3c1f9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 -- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c3c0c9e20 msgr2=0x7f3c3c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c3c0c9e20 0x7f3c3c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 -- 172.21.15.153:0/4180176558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c0ca770 con 0x7f3c3c14ad00 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c33e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c24036040 tx=0x7f3c24033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.359+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24038040 con 0x7f3c3c14ad00 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.360+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c24041070 con 0x7f3c3c14ad00 2024-09-17T03:13:32.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.360+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24033d70 con 0x7f3c3c14ad00 2024-09-17T03:13:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.360+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c1e6850 con 0x7f3c3c14ad00 2024-09-17T03:13:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.360+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c1f8930 con 0x7f3c3c14ad00 2024-09-17T03:13:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.361+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c06ede0 con 0x7f3c3c14ad00 2024-09-17T03:13:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.362+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c2402b8a0 con 0x7f3c3c14ad00 2024-09-17T03:13:32.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.363+0000 7f3c32000640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 0x7f3c1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.363+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f3c240bb3a0 con 0x7f3c3c14ad00 2024-09-17T03:13:32.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.363+0000 7f3c39e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 0x7f3c1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.364+0000 7f3c39e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 0x7f3c1807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000fb0 tx=0x7f3c2c001cd0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.368+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c24083400 con 0x7f3c3c14ad00 2024-09-17T03:13:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:32.554+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f3c3c15b250 con 0x7f3c3c14ad00 2024-09-17T03:13:33.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.097+0000 7f3c32000640 1 -- 172.21.15.153:0/4180176558 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f3c24087e30 con 0x7f3c3c14ad00 2024-09-17T03:13:33.097 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.100+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 msgr2=0x7f3c1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.100+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 0x7f3c1807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000fb0 tx=0x7f3c2c001cd0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.100+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 msgr2=0x7f3c3c1e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.100+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c24036040 tx=0x7f3c24033670 comp rx=0 tx=0).stop 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 shutdown_connections 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3c18078b90 0x7f3c1807b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c3c0c9e20 0x7f3c3c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c3c14ad00 0x7f3c3c1e5db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 --2- 172.21.15.153:0/4180176558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c20003fd0 0x7f3c3c1f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 >> 172.21.15.153:0/4180176558 conn(0x7f3c3c0cca40 msgr2=0x7f3c3c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 shutdown_connections 2024-09-17T03:13:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.101+0000 7f3c40e00640 1 -- 172.21.15.153:0/4180176558 wait complete. 2024-09-17T03:13:33.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:13:33.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 -- 172.21.15.153:0/60420203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380b4f90 msgr2=0x7f2e3806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 --2- 172.21.15.153:0/60420203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380b4f90 0x7f2e3806d780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009830 tx=0x7f2e2002a420 comp rx=0 tx=0).stop 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 -- 172.21.15.153:0/60420203 shutdown_connections 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 --2- 172.21.15.153:0/60420203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e380b4f90 0x7f2e3806d780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 -- 172.21.15.153:0/60420203 >> 172.21.15.153:0/60420203 conn(0x7f2e3806f920 msgr2=0x7f2e380b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 -- 172.21.15.153:0/60420203 shutdown_connections 2024-09-17T03:13:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.367+0000 7f2e3e200640 1 -- 172.21.15.153:0/60420203 wait complete. 2024-09-17T03:13:33.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.369+0000 7f2e3e200640 1 Processor -- start 2024-09-17T03:13:33.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.370+0000 7f2e3e200640 1 -- start start 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e380b4f90 0x7f2e3813e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e380cc8d0 0x7f2e3815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380ce260 con 0x7f2e381456e0 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380ce0e0 con 0x7f2e380cc8d0 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3e200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2e380ce3e0 con 0x7f2e380b4f90 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:33.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38382/0 (socket says 172.21.15.153:38382) 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3d800640 1 -- 172.21.15.153:0/2955860499 learned_addr learned my addr 172.21.15.153:0/2955860499 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e2fe00640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e380cc8d0 0x7f2e3815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.371+0000 7f2e3ce00640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e380b4f90 0x7f2e3813e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 -- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e380b4f90 msgr2=0x7f2e3813e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e380b4f90 0x7f2e3813e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 -- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e380cc8d0 msgr2=0x7f2e3815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e380cc8d0 0x7f2e3815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:33.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 -- 172.21.15.153:0/2955860499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3815c110 con 0x7f2e381456e0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3d800640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c840 tx=0x7f2e3000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30017070 con 0x7f2e381456e0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e30005070 con 0x7f2e381456e0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300054e0 con 0x7f2e381456e0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.372+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e381f9720 con 0x7f2e381456e0 2024-09-17T03:13:33.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.373+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e381f9ce0 con 0x7f2e381456e0 2024-09-17T03:13:33.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.374+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e381f9490 con 0x7f2e381456e0 2024-09-17T03:13:33.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.375+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e3001a070 con 0x7f2e381456e0 2024-09-17T03:13:33.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.376+0000 7f2e35600640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 0x7f2e1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:33.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.376+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f2e3009a3d0 con 0x7f2e381456e0 2024-09-17T03:13:33.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.376+0000 7f2e3ce00640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 0x7f2e1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:33.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.377+0000 7f2e3ce00640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 0x7f2e1407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001720 tx=0x7f2e28009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.381+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e30062210 con 0x7f2e381456e0 2024-09-17T03:13:33.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:33.600+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2e3806d780 con 0x7f2e381456e0 2024-09-17T03:13:34.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.100+0000 7f2e35600640 1 -- 172.21.15.153:0/2955860499 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f2e30066c40 con 0x7f2e381456e0 2024-09-17T03:13:34.099 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 msgr2=0x7f2e1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 0x7f2e1407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001720 tx=0x7f2e28009040 comp rx=0 tx=0).stop 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 msgr2=0x7f2e381f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c840 tx=0x7f2e3000cd00 comp rx=0 tx=0).stop 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 shutdown_connections 2024-09-17T03:13:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e14078b90 0x7f2e1407b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e381456e0 0x7f2e381f61f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e380cc8d0 0x7f2e3815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 --2- 172.21.15.153:0/2955860499 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e380b4f90 0x7f2e3813e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 >> 172.21.15.153:0/2955860499 conn(0x7f2e3806f920 msgr2=0x7f2e380b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 shutdown_connections 2024-09-17T03:13:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.103+0000 7f2e3e200640 1 -- 172.21.15.153:0/2955860499 wait complete. 2024-09-17T03:13:34.147 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-17T03:13:34.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-17T03:13:34.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 -- 172.21.15.153:0/237333812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7340ca690 msgr2=0x7fd734160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 --2- 172.21.15.153:0/237333812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7340ca690 0x7fd734160100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd724009830 tx=0x7fd72402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 -- 172.21.15.153:0/237333812 shutdown_connections 2024-09-17T03:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 --2- 172.21.15.153:0/237333812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7340ca690 0x7fd734160100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 -- 172.21.15.153:0/237333812 >> 172.21.15.153:0/237333812 conn(0x7fd7340ccac0 msgr2=0x7fd7340cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 -- 172.21.15.153:0/237333812 shutdown_connections 2024-09-17T03:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.379+0000 7fd73a600640 1 -- 172.21.15.153:0/237333812 wait complete. 2024-09-17T03:13:34.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.381+0000 7fd73a600640 1 Processor -- start 2024-09-17T03:13:34.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.382+0000 7fd73a600640 1 -- start start 2024-09-17T03:13:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7340ca690 0x7fd734152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd734160640 0x7fd734153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd734160bd0 con 0x7fd73406e2f0 2024-09-17T03:13:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd734160a50 con 0x7fd7340ca690 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd73a600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd734160d50 con 0x7fd734160640 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd733400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd733400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54730/0 (socket says 172.21.15.153:54730) 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd733400640 1 -- 172.21.15.153:0/3615476729 learned_addr learned my addr 172.21.15.153:0/3615476729 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.383+0000 7fd72be00640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7340ca690 0x7fd734152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733e00640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd734160640 0x7fd734153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 -- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd734160640 msgr2=0x7fd734153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd734160640 0x7fd734153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 -- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7340ca690 msgr2=0x7fd734152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7340ca690 0x7fd734152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 -- 172.21.15.153:0/3615476729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7340c6640 con 0x7fd73406e2f0 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd733400640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd72402abb0 tx=0x7fd724033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724031d60 con 0x7fd73406e2f0 2024-09-17T03:13:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd724033e10 con 0x7fd73406e2f0 2024-09-17T03:13:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724005260 con 0x7fd73406e2f0 2024-09-17T03:13:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7340c6920 con 0x7fd73406e2f0 2024-09-17T03:13:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.384+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7340b5980 con 0x7fd73406e2f0 2024-09-17T03:13:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.385+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7340710c0 con 0x7fd73406e2f0 2024-09-17T03:13:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.387+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd724005400 con 0x7fd73406e2f0 2024-09-17T03:13:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.387+0000 7fd72b400640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 0x7fd71007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.388+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd7240bbe10 con 0x7fd73406e2f0 2024-09-17T03:13:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.388+0000 7fd72be00640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 0x7fd71007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.389+0000 7fd72be00640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 0x7fd71007b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd734074f10 tx=0x7fd71c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:34.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.392+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7340710c0 con 0x7fd73406e2f0 2024-09-17T03:13:34.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:34.582+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd734160100 con 0x7fd73406e2f0 2024-09-17T03:13:35.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.118+0000 7fd72b400640 1 -- 172.21.15.153:0/3615476729 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7fd7240bf030 con 0x7fd73406e2f0 2024-09-17T03:13:35.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 msgr2=0x7fd71007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 0x7fd71007b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd734074f10 tx=0x7fd71c009040 comp rx=0 tx=0).stop 2024-09-17T03:13:35.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 msgr2=0x7fd7340b03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd72402abb0 tx=0x7fd724033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 shutdown_connections 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd710078b90 0x7fd71007b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd734160640 0x7fd734153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7340ca690 0x7fd734152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 --2- 172.21.15.153:0/3615476729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd73406e2f0 0x7fd7340b03b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 >> 172.21.15.153:0/3615476729 conn(0x7fd7340ccac0 msgr2=0x7fd7340aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 shutdown_connections 2024-09-17T03:13:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.121+0000 7fd73a600640 1 -- 172.21.15.153:0/3615476729 wait complete. 2024-09-17T03:13:35.144 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:13:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 -- 172.21.15.153:0/1795650833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ddc003a00 msgr2=0x7f3ddc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 --2- 172.21.15.153:0/1795650833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ddc003a00 0x7f3ddc003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3de800bbb0 tx=0x7f3ddc005830 comp rx=0 tx=0).stop 2024-09-17T03:13:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3df7e00640 1 -- 172.21.15.153:0/1795650833 reap_dead start 2024-09-17T03:13:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 -- 172.21.15.153:0/1795650833 shutdown_connections 2024-09-17T03:13:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 -- 172.21.15.153:0/1795650833 >> 172.21.15.153:0/1795650833 conn(0x7f3df80b4030 msgr2=0x7f3df80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 -- 172.21.15.153:0/1795650833 shutdown_connections 2024-09-17T03:13:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.379+0000 7f3dfe800640 1 -- 172.21.15.153:0/1795650833 wait complete. 2024-09-17T03:13:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.381+0000 7f3dfe800640 1 Processor -- start 2024-09-17T03:13:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.381+0000 7f3dfe800640 1 -- start start 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ddc003a00 0x7f3df81f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3df81554f0 0x7f3df8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3df815db40 con 0x7f3df815b940 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3df80b39e0 con 0x7f3df81554f0 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3dfe800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3df8155130 con 0x7f3ddc003a00 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54742/0 (socket says 172.21.15.153:54742) 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 -- 172.21.15.153:0/4143585913 learned_addr learned my addr 172.21.15.153:0/4143585913 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 -- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ddc003a00 msgr2=0x7f3df81f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ddc003a00 0x7f3df81f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 -- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3df81554f0 msgr2=0x7f3df8155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3df81554f0 0x7f3df8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.383+0000 7f3defe00640 1 -- 172.21.15.153:0/4143585913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df81f9dc0 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3defe00640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3de00118a0 tx=0x7f3de0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004460 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3de000f920 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de000fd70 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df81f5850 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.384+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df81f5f50 con 0x7f3df815b940 2024-09-17T03:13:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.385+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df8160070 con 0x7f3df815b940 2024-09-17T03:13:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.386+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3de00035f0 con 0x7f3df815b940 2024-09-17T03:13:35.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.387+0000 7f3def400640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 0x7f3dd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.387+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7f3de009bb20 con 0x7f3df815b940 2024-09-17T03:13:35.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.388+0000 7f3df7400640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 0x7f3dd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.388+0000 7f3df7400640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 0x7f3dd407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3de8036000 tx=0x7f3de8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:35.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.391+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3df8160070 con 0x7f3df815b940 2024-09-17T03:13:35.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:35.578+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3df81604d0 con 0x7f3df815b940 2024-09-17T03:13:37.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.135+0000 7f3def400640 1 -- 172.21.15.153:0/4143585913 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7f3df81f9dc0 con 0x7f3df815b940 2024-09-17T03:13:37.135 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data_ec' created 2024-09-17T03:13:37.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 msgr2=0x7f3dd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 0x7f3dd407b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3de8036000 tx=0x7f3de8004730 comp rx=0 tx=0).stop 2024-09-17T03:13:37.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 msgr2=0x7f3df815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3de00118a0 tx=0x7f3de0011d60 comp rx=0 tx=0).stop 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 shutdown_connections 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3dd4078b90 0x7f3dd407b0a0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3de8036000 tx=0x7f3de8004730 comp rx=0 tx=0).stop 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3df81554f0 0x7f3df8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df815b940 0x7f3df815bd50 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3de00118a0 tx=0x7f3de0011d60 comp rx=0 tx=0).stop 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 --2- 172.21.15.153:0/4143585913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ddc003a00 0x7f3df81f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.140+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 >> 172.21.15.153:0/4143585913 conn(0x7f3df80b4030 msgr2=0x7f3df815f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:37.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.142+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 shutdown_connections 2024-09-17T03:13:37.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.142+0000 7f3dfe800640 1 -- 172.21.15.153:0/4143585913 wait complete. 2024-09-17T03:13:37.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-17T03:13:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 -- 172.21.15.153:0/2359238098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 msgr2=0x7f99bc1604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 --2- 172.21.15.153:0/2359238098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1604a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0cfa70 tx=0x7f99a802a540 comp rx=0 tx=0).stop 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 -- 172.21.15.153:0/2359238098 shutdown_connections 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 --2- 172.21.15.153:0/2359238098 >> v2:172.21.15.164:3300/0 conn(0x7f99bc0ceaf0 0x7f99bc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 --2- 172.21.15.153:0/2359238098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1604a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 --2- 172.21.15.153:0/2359238098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0b2e60 0x7f99bc15ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 -- 172.21.15.153:0/2359238098 >> 172.21.15.153:0/2359238098 conn(0x7f99bc0d0460 msgr2=0x7f99bc06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 -- 172.21.15.153:0/2359238098 shutdown_connections 2024-09-17T03:13:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.404+0000 7f99c2e00640 1 -- 172.21.15.153:0/2359238098 wait complete. 2024-09-17T03:13:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.407+0000 7f99c2e00640 1 Processor -- start 2024-09-17T03:13:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.407+0000 7f99c2e00640 1 -- start start 2024-09-17T03:13:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0b2e60 0x7f99bc1eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0ceaf0 0x7f99bc1ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc06fdd0 con 0x7f99bc145cc0 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc06fc50 con 0x7f99bc0b2e60 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f99bc06ff50 con 0x7f99bc0ceaf0 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.408+0000 7f99c2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54764/0 (socket says 172.21.15.153:54764) 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 -- 172.21.15.153:0/4047684814 learned_addr learned my addr 172.21.15.153:0/4047684814 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c1000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0ceaf0 0x7f99bc1ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c1a00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0b2e60 0x7f99bc1eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 -- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0ceaf0 msgr2=0x7f99bc1ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0ceaf0 0x7f99bc1ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 -- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0b2e60 msgr2=0x7f99bc1eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0b2e60 0x7f99bc1eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 -- 172.21.15.153:0/4047684814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0ae740 con 0x7f99bc145cc0 2024-09-17T03:13:37.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99c2400640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99b400d960 tx=0x7f99b400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:37.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.409+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4017070 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.410+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99b400be20 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.410+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc0aea20 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.410+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40106a0 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.410+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc0aefe0 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.411+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99bc070470 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.412+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99b401a070 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.413+0000 7f99b9600640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 0x7f999c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.413+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f99b409b490 con 0x7f99bc145cc0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.413+0000 7f99c1a00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 0x7f999c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.414+0000 7f99c1a00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 0x7f999c07b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005fd0 tx=0x7f99b000b260 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:37.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.418+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99b4062f40 con 0x7f99bc145cc0 2024-09-17T03:13:37.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:37.603+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f99bc160340 con 0x7f99bc145cc0 2024-09-17T03:13:38.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.138+0000 7f99b9600640 1 -- 172.21.15.153:0/4047684814 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f99b4067970 con 0x7f99bc145cc0 2024-09-17T03:13:38.137 INFO:teuthology.orchestra.run.smithi153.stderr:set pool 4 allow_ec_overwrites to true 2024-09-17T03:13:38.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 msgr2=0x7f999c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 0x7f999c07b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005fd0 tx=0x7f99b000b260 comp rx=0 tx=0).stop 2024-09-17T03:13:38.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 msgr2=0x7f99bc1f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f99b400d960 tx=0x7f99b400de20 comp rx=0 tx=0).stop 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 shutdown_connections 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f999c078b90 0x7f999c07b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99bc145cc0 0x7f99bc1f8c00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc0ceaf0 0x7f99bc1ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 --2- 172.21.15.153:0/4047684814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0b2e60 0x7f99bc1eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.140+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 >> 172.21.15.153:0/4047684814 conn(0x7f99bc0d0460 msgr2=0x7f99bc15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.141+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 shutdown_connections 2024-09-17T03:13:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.141+0000 7f99c2e00640 1 -- 172.21.15.153:0/4047684814 wait complete. 2024-09-17T03:13:38.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f931ba00640 1 -- 172.21.15.153:0/1359892441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92fc003a00 msgr2=0x7f92fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f931ba00640 1 --2- 172.21.15.153:0/1359892441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92fc003a00 0x7f92fc003e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9308009b50 tx=0x7f92fc005830 comp rx=0 tx=0).stop 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f9319a00640 1 -- 172.21.15.153:0/1359892441 reap_dead start 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f931ba00640 1 -- 172.21.15.153:0/1359892441 shutdown_connections 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f931ba00640 1 -- 172.21.15.153:0/1359892441 >> 172.21.15.153:0/1359892441 conn(0x7f93140b1b90 msgr2=0x7f93140b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.414+0000 7f931ba00640 1 -- 172.21.15.153:0/1359892441 shutdown_connections 2024-09-17T03:13:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.415+0000 7f931ba00640 1 -- 172.21.15.153:0/1359892441 wait complete. 2024-09-17T03:13:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.417+0000 7f931ba00640 1 Processor -- start 2024-09-17T03:13:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.417+0000 7f931ba00640 1 -- start start 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92fc003a00 0x7f93141f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93140b4cd0 0x7f93140b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f931406df70 con 0x7f93140c73f0 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f931406ddf0 con 0x7f93140b4cd0 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f931ba00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f931406e0f0 con 0x7f92fc003a00 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.418+0000 7f9313e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54770/0 (socket says 172.21.15.153:54770) 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 -- 172.21.15.153:0/3743403212 learned_addr learned my addr 172.21.15.153:0/3743403212 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9319a00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93140b4cd0 0x7f93140b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9319000640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92fc003a00 0x7f93141f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 -- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92fc003a00 msgr2=0x7f93141f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92fc003a00 0x7f93141f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 -- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93140b4cd0 msgr2=0x7f93140b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93140b4cd0 0x7f93140b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 -- 172.21.15.153:0/3743403212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140c8120 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9313e00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9300011a80 tx=0x7f9300011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.419+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000fe10 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.420+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9300016070 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.420+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93140c8400 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.420+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300012690 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.420+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93140c89c0 con 0x7f93140c73f0 2024-09-17T03:13:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.421+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9314074620 con 0x7f93140c73f0 2024-09-17T03:13:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.422+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9300018030 con 0x7f93140c73f0 2024-09-17T03:13:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.423+0000 7f9310c00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 0x7f92f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.423+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f930009b940 con 0x7f93140c73f0 2024-09-17T03:13:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.423+0000 7f9319000640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 0x7f92f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.424+0000 7f9319000640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 0x7f92f407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9308009b50 tx=0x7f930802d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.427+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9300063370 con 0x7f93140c73f0 2024-09-17T03:13:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:38.647+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f93140c7eb0 con 0x7f93140c73f0 2024-09-17T03:13:39.081 INFO:tasks.ceph.mds.d.smithi164.stderr:2024-09-17T03:13:39.081+0000 7f9022400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:13:39.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.161+0000 7f9310c00640 1 -- 172.21.15.153:0/3743403212 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f9300067da0 con 0x7f93140c73f0 2024-09-17T03:13:39.160 INFO:teuthology.orchestra.run.smithi153.stderr:added data pool 4 to fsmap 2024-09-17T03:13:39.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 msgr2=0x7f92f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 0x7f92f407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9308009b50 tx=0x7f930802d040 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 msgr2=0x7f93140c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9300011a80 tx=0x7f9300011f40 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 shutdown_connections 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f92f4078bc0 0x7f92f407b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93140b4cd0 0x7f93140b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93140c73f0 0x7f93140c7800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 --2- 172.21.15.153:0/3743403212 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92fc003a00 0x7f93141f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 >> 172.21.15.153:0/3743403212 conn(0x7f93140b1b90 msgr2=0x7f93140b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.163+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 shutdown_connections 2024-09-17T03:13:39.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.164+0000 7f931ba00640 1 -- 172.21.15.153:0/3743403212 wait complete. 2024-09-17T03:13:39.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:39.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 -- 172.21.15.153:0/864015629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d40ceb20 msgr2=0x7f63d4074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 --2- 172.21.15.153:0/864015629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d40ceb20 0x7f63d4074070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f63d40b6840 tx=0x7f63c802a540 comp rx=0 tx=0).stop 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 -- 172.21.15.153:0/864015629 shutdown_connections 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 --2- 172.21.15.153:0/864015629 >> v2:172.21.15.164:3300/0 conn(0x7f63d406ddf0 0x7f63d406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 --2- 172.21.15.153:0/864015629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d40ceb20 0x7f63d4074070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 -- 172.21.15.153:0/864015629 >> 172.21.15.153:0/864015629 conn(0x7f63d4073400 msgr2=0x7f63d4073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 -- 172.21.15.153:0/864015629 shutdown_connections 2024-09-17T03:13:39.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.410+0000 7f63dae00640 1 -- 172.21.15.153:0/864015629 wait complete. 2024-09-17T03:13:39.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.412+0000 7f63dae00640 1 Processor -- start 2024-09-17T03:13:39.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.413+0000 7f63dae00640 1 -- start start 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63d40addb0 0x7f63d40c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 0x7f63d4160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f63d40ae8d0 con 0x7f63d406ddf0 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f63d40cc7e0 con 0x7f63d40ceb20 2024-09-17T03:13:39.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63dae00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f63d40aea50 con 0x7f63d40addb0 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54796/0 (socket says 172.21.15.153:54796) 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63d9a00640 1 -- 172.21.15.153:0/329885249 learned_addr learned my addr 172.21.15.153:0/329885249 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.414+0000 7f63d9000640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63d40addb0 0x7f63d40c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 -- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63d40addb0 msgr2=0x7f63d40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63da400640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 0x7f63d4160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63d40addb0 0x7f63d40c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 -- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 msgr2=0x7f63d4160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 0x7f63d4160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 -- 172.21.15.153:0/329885249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d40c4720 con 0x7f63d406ddf0 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63da400640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 0x7f63d4160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d9a00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009920 tx=0x7f63c8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8031d60 con 0x7f63d406ddf0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63c8005020 con 0x7f63d406ddf0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8005470 con 0x7f63d406ddf0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d40ca880 con 0x7f63d406ddf0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.415+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d40c8d30 con 0x7f63d406ddf0 2024-09-17T03:13:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.417+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d406e200 con 0x7f63d406ddf0 2024-09-17T03:13:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.417+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63c80047a0 con 0x7f63d406ddf0 2024-09-17T03:13:39.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.419+0000 7f63d1600640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 0x7f63b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.419+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f63c80bc310 con 0x7f63d406ddf0 2024-09-17T03:13:39.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.419+0000 7f63d9000640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 0x7f63b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.420+0000 7f63d9000640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 0x7f63b407b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63d40ae7c0 tx=0x7f63c0005c20 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.424+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63c803f030 con 0x7f63d406ddf0 2024-09-17T03:13:39.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.641+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63d4071320 con 0x7f63d406ddf0 2024-09-17T03:13:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.642+0000 7f63d1600640 1 -- 172.21.15.153:0/329885249 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f63c8084490 con 0x7f63d406ddf0 2024-09-17T03:13:39.641 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:39.641 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"btime":"2024-09-17T03:13:39:149251+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:38.649329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:13:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2024-09-17T03:13:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 msgr2=0x7f63b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 0x7f63b407b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63d40ae7c0 tx=0x7f63c0005c20 comp rx=0 tx=0).stop 2024-09-17T03:13:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 msgr2=0x7f63d41f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009920 tx=0x7f63c8033d60 comp rx=0 tx=0).stop 2024-09-17T03:13:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 shutdown_connections 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f63b4078bc0 0x7f63b407b0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63d40ceb20 0x7f63d4160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f63d40addb0 0x7f63d40c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 --2- 172.21.15.153:0/329885249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63d406ddf0 0x7f63d41f5f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 >> 172.21.15.153:0/329885249 conn(0x7f63d4073400 msgr2=0x7f63d4071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 shutdown_connections 2024-09-17T03:13:39.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.644+0000 7f63dae00640 1 -- 172.21.15.153:0/329885249 wait complete. 2024-09-17T03:13:39.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 -- 172.21.15.153:0/3942879575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc70071870 msgr2=0x7fdc70145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 --2- 172.21.15.153:0/3942879575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc70071870 0x7fdc70145040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009830 tx=0x7fdc5802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 -- 172.21.15.153:0/3942879575 shutdown_connections 2024-09-17T03:13:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 --2- 172.21.15.153:0/3942879575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc70071870 0x7fdc70145040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 -- 172.21.15.153:0/3942879575 >> 172.21.15.153:0/3942879575 conn(0x7fdc700d1020 msgr2=0x7fdc700d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 -- 172.21.15.153:0/3942879575 shutdown_connections 2024-09-17T03:13:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.889+0000 7fdc76400640 1 -- 172.21.15.153:0/3942879575 wait complete. 2024-09-17T03:13:39.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.891+0000 7fdc76400640 1 Processor -- start 2024-09-17T03:13:39.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.892+0000 7fdc76400640 1 -- start start 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc700d0b00 0x7fdc7015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc701f9110 0x7fdc700b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc700cdf50 con 0x7fdc70160990 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70072240 con 0x7fdc701f9110 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc76400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdc700ce0d0 con 0x7fdc700d0b00 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc67e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc67e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54812/0 (socket says 172.21.15.153:54812) 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc67e00640 1 -- 172.21.15.153:0/1286875498 learned_addr learned my addr 172.21.15.153:0/1286875498 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc75000640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc700d0b00 0x7fdc7015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.893+0000 7fdc75a00640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc701f9110 0x7fdc700b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 -- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc700d0b00 msgr2=0x7fdc7015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc700d0b00 0x7fdc7015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 -- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc701f9110 msgr2=0x7fdc700b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc701f9110 0x7fdc700b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 -- 172.21.15.153:0/1286875498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc701f50c0 con 0x7fdc70160990 2024-09-17T03:13:39.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc67e00640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009950 tx=0x7fdc58033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58005c90 con 0x7fdc70160990 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc58031e50 con 0x7fdc70160990 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58005260 con 0x7fdc70160990 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.894+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc701f53a0 con 0x7fdc70160990 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.895+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc701f5960 con 0x7fdc70160990 2024-09-17T03:13:39.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.896+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc70145040 con 0x7fdc70160990 2024-09-17T03:13:39.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.897+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc58005400 con 0x7fdc70160990 2024-09-17T03:13:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.898+0000 7fdc6d600640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.899+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdc580bc110 con 0x7fdc70160990 2024-09-17T03:13:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.899+0000 7fdc75000640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.899+0000 7fdc75000640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001120 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:39.903+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc5803f030 con 0x7fdc70160990 2024-09-17T03:13:40.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.086+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc700d1710 con 0x7fdc70160990 2024-09-17T03:13:40.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.087+0000 7fdc6d600640 1 -- 172.21.15.153:0/1286875498 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7fdc58083b20 con 0x7fdc70160990 2024-09-17T03:13:40.086 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:40.087 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.089+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 msgr2=0x7fdc4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.089+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001120 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 msgr2=0x7fdc701f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009950 tx=0x7fdc58033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 shutdown_connections 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc701f9110 0x7fdc700b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc70160990 0x7fdc701f8bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 --2- 172.21.15.153:0/1286875498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc700d0b00 0x7fdc7015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 >> 172.21.15.153:0/1286875498 conn(0x7fdc700d1020 msgr2=0x7fdc700b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 shutdown_connections 2024-09-17T03:13:40.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.090+0000 7fdc76400640 1 -- 172.21.15.153:0/1286875498 wait complete. 2024-09-17T03:13:40.110 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 -- 172.21.15.153:0/1998265005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f00cbc10 msgr2=0x7f22f00cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 --2- 172.21.15.153:0/1998265005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f00cbc10 0x7f22f00cc020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009830 tx=0x7f22d802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 -- 172.21.15.153:0/1998265005 shutdown_connections 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 --2- 172.21.15.153:0/1998265005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f00cbc10 0x7f22f00cc020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 --2- 172.21.15.153:0/1998265005 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 0x7f22f0073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.331+0000 7f22f6600640 1 -- 172.21.15.153:0/1998265005 >> 172.21.15.153:0/1998265005 conn(0x7f22f00cca40 msgr2=0x7f22f00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.332+0000 7f22f6600640 1 -- 172.21.15.153:0/1998265005 shutdown_connections 2024-09-17T03:13:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.332+0000 7f22f6600640 1 -- 172.21.15.153:0/1998265005 wait complete. 2024-09-17T03:13:40.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.334+0000 7f22f6600640 1 Processor -- start 2024-09-17T03:13:40.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.334+0000 7f22f6600640 1 -- start start 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.335+0000 7f22f6600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 0x7f22f0153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22f6600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 0x7f22f01f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22f6600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22f6600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f22f006f360 con 0x7f22f00cbc10 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22f6600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f22f006f1e0 con 0x7f22f006ddf0 2024-09-17T03:13:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22f6600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f22f006f4e0 con 0x7f22f0074cb0 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54828/0 (socket says 172.21.15.153:54828) 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 -- 172.21.15.153:0/3440040857 learned_addr learned my addr 172.21.15.153:0/3440040857 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22ef400640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 0x7f22f0153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22e6a00640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 0x7f22f01f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 -- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 msgr2=0x7f22f01f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 0x7f22f01f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 -- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 msgr2=0x7f22f0153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 0x7f22f0153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22efe00640 1 -- 172.21.15.153:0/3440040857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f015a3e0 con 0x7f22f00cbc10 2024-09-17T03:13:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.336+0000 7f22ef400640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 0x7f22f0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:40.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22efe00640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22e800cb40 tx=0x7f22e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8016020 con 0x7f22f00cbc10 2024-09-17T03:13:40.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22e800ad90 con 0x7f22f00cbc10 2024-09-17T03:13:40.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8012680 con 0x7f22f00cbc10 2024-09-17T03:13:40.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f01f9530 con 0x7f22f00cbc10 2024-09-17T03:13:40.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.337+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f00b54e0 con 0x7f22f00cbc10 2024-09-17T03:13:40.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.338+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f006fa00 con 0x7f22f00cbc10 2024-09-17T03:13:40.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.339+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22e8019020 con 0x7f22f00cbc10 2024-09-17T03:13:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.340+0000 7f22e7e00640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.340+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f22e809b7a0 con 0x7f22f00cbc10 2024-09-17T03:13:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.341+0000 7f22ef400640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.342+0000 7f22ef400640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22f015a730 tx=0x7f22e0005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.345+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22e8020020 con 0x7f22f00cbc10 2024-09-17T03:13:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.530+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f015e2b0 con 0x7f22f00cbc10 2024-09-17T03:13:40.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.531+0000 7f22e7e00640 1 -- 172.21.15.153:0/3440040857 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f22e8063890 con 0x7f22f00cbc10 2024-09-17T03:13:40.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:40.531 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 msgr2=0x7f22cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22f015a730 tx=0x7f22e0005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 msgr2=0x7f22f01f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22e800cb40 tx=0x7f22e800a060 comp rx=0 tx=0).stop 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 shutdown_connections 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f00cbc10 0x7f22f01f8da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f0074cb0 0x7f22f01f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 --2- 172.21.15.153:0/3440040857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f006ddf0 0x7f22f0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 >> 172.21.15.153:0/3440040857 conn(0x7f22f00cca40 msgr2=0x7f22f00cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 shutdown_connections 2024-09-17T03:13:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.534+0000 7f22f6600640 1 -- 172.21.15.153:0/3440040857 wait complete. 2024-09-17T03:13:40.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 -- 172.21.15.153:0/2857985180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf78074cb0 msgr2=0x7faf78073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 --2- 172.21.15.153:0/2857985180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf78074cb0 0x7faf78073dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009830 tx=0x7faf6c02a510 comp rx=0 tx=0).stop 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 -- 172.21.15.153:0/2857985180 shutdown_connections 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 --2- 172.21.15.153:0/2857985180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf7806e500 0x7faf780cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 --2- 172.21.15.153:0/2857985180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf78074cb0 0x7faf78073dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 -- 172.21.15.153:0/2857985180 >> 172.21.15.153:0/2857985180 conn(0x7faf780cca40 msgr2=0x7faf780cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 -- 172.21.15.153:0/2857985180 shutdown_connections 2024-09-17T03:13:40.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.795+0000 7faf7f600640 1 -- 172.21.15.153:0/2857985180 wait complete. 2024-09-17T03:13:40.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.797+0000 7faf7f600640 1 Processor -- start 2024-09-17T03:13:40.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.797+0000 7faf7f600640 1 -- start start 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 0x7faf781f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf781f85f0 0x7faf781f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf7806f3f0 con 0x7faf78074cb0 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf7806f270 con 0x7faf780cbc10 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7f600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf7806f570 con 0x7faf781f85f0 2024-09-17T03:13:40.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54834/0 (socket says 172.21.15.153:54834) 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 -- 172.21.15.153:0/1064537854 learned_addr learned my addr 172.21.15.153:0/1064537854 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf77e00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 0x7faf781f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7d600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf781f85f0 0x7faf781f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 -- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf781f85f0 msgr2=0x7faf781f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf781f85f0 0x7faf781f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 -- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 msgr2=0x7faf781f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 0x7faf781f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf7cc00640 1 -- 172.21.15.153:0/1064537854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf781f8f40 con 0x7faf78074cb0 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.799+0000 7faf77e00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 0x7faf781f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf7cc00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009950 tx=0x7faf6c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c005c90 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf6c031e50 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7809d500 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0332f0 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.800+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7809d7e0 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.801+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7806fa90 con 0x7faf78074cb0 2024-09-17T03:13:40.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.803+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf6c033490 con 0x7faf78074cb0 2024-09-17T03:13:40.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.804+0000 7faf74c00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 0x7faf5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.804+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faf6c0bc410 con 0x7faf78074cb0 2024-09-17T03:13:40.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.804+0000 7faf77e00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 0x7faf5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.805+0000 7faf77e00640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 0x7faf5807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf7806e3e0 tx=0x7faf64009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:40.808+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf781f8f40 con 0x7faf78074cb0 2024-09-17T03:13:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.026+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf7806de50 con 0x7faf78074cb0 2024-09-17T03:13:41.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.027+0000 7faf74c00640 1 -- 172.21.15.153:0/1064537854 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7faf6c03f030 con 0x7faf78074cb0 2024-09-17T03:13:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:41.026 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"btime":"2024-09-17T03:13:39:149251+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:38.649329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:13:41.027 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 msgr2=0x7faf5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 0x7faf5807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf7806e3e0 tx=0x7faf64009040 comp rx=0 tx=0).stop 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 msgr2=0x7faf781502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009950 tx=0x7faf6c033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 shutdown_connections 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faf58078b90 0x7faf5807b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf781f85f0 0x7faf781f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf780cbc10 0x7faf781f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 --2- 172.21.15.153:0/1064537854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf78074cb0 0x7faf781502e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 >> 172.21.15.153:0/1064537854 conn(0x7faf780cca40 msgr2=0x7faf781e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 shutdown_connections 2024-09-17T03:13:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.030+0000 7faf7f600640 1 -- 172.21.15.153:0/1064537854 wait complete. 2024-09-17T03:13:41.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:41.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 -- 172.21.15.153:0/52648766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 msgr2=0x7fe4f406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/52648766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f406e200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40cfe90 tx=0x7fe4ec02aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 -- 172.21.15.153:0/52648766 shutdown_connections 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/52648766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f406e200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/52648766 >> v2:172.21.15.164:3300/0 conn(0x7fe4f40cbc10 0x7fe4f40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/52648766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f4074cb0 0x7fe4f4073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 -- 172.21.15.153:0/52648766 >> 172.21.15.153:0/52648766 conn(0x7fe4f40cca40 msgr2=0x7fe4f40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 -- 172.21.15.153:0/52648766 shutdown_connections 2024-09-17T03:13:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.281+0000 7fe4f9a00640 1 -- 172.21.15.153:0/52648766 wait complete. 2024-09-17T03:13:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.284+0000 7fe4f9a00640 1 Processor -- start 2024-09-17T03:13:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.284+0000 7fe4f9a00640 1 -- start start 2024-09-17T03:13:41.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:41.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4f4074cb0 0x7fe4f4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:41.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f40cbc10 0x7fe4f41518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f406f170 con 0x7fe4f406ddf0 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f406eff0 con 0x7fe4f4074cb0 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f9a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f406f2f0 con 0x7fe4f40cbc10 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54842/0 (socket says 172.21.15.153:54842) 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.285+0000 7fe4f2a00640 1 -- 172.21.15.153:0/2764471537 learned_addr learned my addr 172.21.15.153:0/2764471537 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4ea000640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4f4074cb0 0x7fe4f4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f3400640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f40cbc10 0x7fe4f41518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 -- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f40cbc10 msgr2=0x7fe4f41518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f40cbc10 0x7fe4f41518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 -- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4f4074cb0 msgr2=0x7fe4f4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4f4074cb0 0x7fe4f4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 -- 172.21.15.153:0/2764471537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f4156e20 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f2a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c970 tx=0x7fe4e400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4004230 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4e40044c0 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f4157100 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.286+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4007b90 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.287+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f41576c0 con 0x7fe4f406ddf0 2024-09-17T03:13:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.288+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f4072860 con 0x7fe4f406ddf0 2024-09-17T03:13:41.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.289+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4e40035f0 con 0x7fe4f406ddf0 2024-09-17T03:13:41.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.290+0000 7fe4eb400640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 0x7fe4d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.290+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe4e409b3f0 con 0x7fe4f406ddf0 2024-09-17T03:13:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.290+0000 7fe4ea000640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 0x7fe4d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.291+0000 7fe4ea000640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 0x7fe4d007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4f41517f0 tx=0x7fe4dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.294+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe4f4072860 con 0x7fe4f406ddf0 2024-09-17T03:13:41.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.478+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4f4073dd0 con 0x7fe4f406ddf0 2024-09-17T03:13:41.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.479+0000 7fe4eb400640 1 -- 172.21.15.153:0/2764471537 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7fe4e4014070 con 0x7fe4f406ddf0 2024-09-17T03:13:41.478 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:41.478 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:41.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 msgr2=0x7fe4d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 0x7fe4d007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4f41517f0 tx=0x7fe4dc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 msgr2=0x7fe4f4152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:41.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c970 tx=0x7fe4e400ce30 comp rx=0 tx=0).stop 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 shutdown_connections 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe4d0078bc0 0x7fe4d007b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe4f40cbc10 0x7fe4f41518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4f4074cb0 0x7fe4f4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 --2- 172.21.15.153:0/2764471537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f406ddf0 0x7fe4f4152fd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 >> 172.21.15.153:0/2764471537 conn(0x7fe4f40cca40 msgr2=0x7fe4f415f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 shutdown_connections 2024-09-17T03:13:41.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:41.481+0000 7fe4f9a00640 1 -- 172.21.15.153:0/2764471537 wait complete. 2024-09-17T03:13:41.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:13:33.601612+0000', 'modified': '2024-09-17T03:13:38.649329+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6837/842621775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6835', 'nonce': 842621775}, {'type': 'v1', 'addr': '172.21.15.164:6837', 'nonce': 842621775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4371, 'qdb_cluster': [4371]} 2024-09-17T03:13:41.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:13:41.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:13:42.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 -- 172.21.15.153:0/1313180884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c900cef00 msgr2=0x7f4c900cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1313180884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c900cef00 0x7f4c900cf310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c90074160 tx=0x7f4c8802aac0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 -- 172.21.15.153:0/1313180884 shutdown_connections 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1313180884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c900cef00 0x7f4c900cf310 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1313180884 >> v2:172.21.15.164:3300/0 conn(0x7f4c9006ddf0 0x7f4c9006e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.129+0000 7f4c94a00640 1 -- 172.21.15.153:0/1313180884 >> 172.21.15.153:0/1313180884 conn(0x7f4c900b1b90 msgr2=0x7f4c900b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.130+0000 7f4c94a00640 1 -- 172.21.15.153:0/1313180884 shutdown_connections 2024-09-17T03:13:42.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.130+0000 7f4c94a00640 1 -- 172.21.15.153:0/1313180884 wait complete. 2024-09-17T03:13:42.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.132+0000 7f4c94a00640 1 Processor -- start 2024-09-17T03:13:42.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.132+0000 7f4c94a00640 1 -- start start 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c900cef00 0x7f4c900c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 0x7f4c901f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900cf850 con 0x7f4c9006ddf0 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90161060 con 0x7f4c90156a50 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c94a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4c900cf9d0 con 0x7f4c900cef00 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54870/0 (socket says 172.21.15.153:54870) 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 -- 172.21.15.153:0/1430098055 learned_addr learned my addr 172.21.15.153:0/1430098055 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8d400640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c900cef00 0x7f4c900c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8e800640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 0x7f4c901f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 -- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c900cef00 msgr2=0x7f4c900c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c900cef00 0x7f4c900c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 -- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 msgr2=0x7f4c901f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 0x7f4c901f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8de00640 1 -- 172.21.15.153:0/1430098055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c900ca0a0 con 0x7f4c9006ddf0 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.134+0000 7f4c8e800640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 0x7f4c901f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c8de00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c3a0 tx=0x7f4c8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c86000640 1 -- 172.21.15.153:0/1430098055 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80017070 con 0x7f4c9006ddf0 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c86000640 1 -- 172.21.15.153:0/1430098055 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c800053c0 con 0x7f4c9006ddf0 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c86000640 1 -- 172.21.15.153:0/1430098055 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80003850 con 0x7f4c9006ddf0 2024-09-17T03:13:42.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c900b5800 con 0x7f4c9006ddf0 2024-09-17T03:13:42.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.135+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c900b5a90 con 0x7f4c9006ddf0 2024-09-17T03:13:42.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.138+0000 7f4c86000640 1 -- 172.21.15.153:0/1430098055 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c8001a070 con 0x7f4c9006ddf0 2024-09-17T03:13:42.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.138+0000 7f4c86000640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.139+0000 7f4c86000640 1 -- 172.21.15.153:0/1430098055 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4c8009a420 con 0x7f4c9006ddf0 2024-09-17T03:13:42.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.139+0000 7f4c8d400640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.139+0000 7f4c9bbcd740 1 Processor -- start 2024-09-17T03:13:42.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.140+0000 7f4c9bbcd740 1 -- start start 2024-09-17T03:13:42.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.140+0000 7f4c8d400640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 0x7f4c7007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c9015a130 tx=0x7f4c7c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 0x55f84a5d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a586f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a5874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f84a510430 con 0x55f84a1c5590 2024-09-17T03:13:42.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f84a5005d0 con 0x55f84a1e6270 2024-09-17T03:13:42.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55f84a4efa00 con 0x55f84a1bd3b0 2024-09-17T03:13:42.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.141+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a5874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 0x55f84a5d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a586f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 0x55f84a5d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:42922/0 (socket says 172.21.15.153:42922) 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8de00640 1 -- 172.21.15.153:0/3039190456 learned_addr learned my addr 172.21.15.153:0/3039190456 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a586f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:54416/0 (socket says 172.21.15.153:54416) 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 -- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 msgr2=0x55f84a586f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a586f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 -- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 msgr2=0x55f84a5d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 0x55f84a5d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 -- 172.21.15.153:0/3039190456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84a4b8520 con 0x55f84a1c5590 2024-09-17T03:13:42.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.142+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a5874a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c88032000 tx=0x7f4c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b06865366a04e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.143+0000 7f4c7a600640 1 -- 172.21.15.153:0/3039190456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88045070 con 0x55f84a1c5590 2024-09-17T03:13:42.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.143+0000 7f4c7a600640 1 -- 172.21.15.153:0/3039190456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8802cab0 con 0x55f84a1c5590 2024-09-17T03:13:42.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.143+0000 7f4c7a600640 1 -- 172.21.15.153:0/3039190456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8802cea0 con 0x55f84a1c5590 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.143+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3039190456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 msgr2=0x55f84a5874a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.143+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a5874a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c88032000 tx=0x7f4c88004a40 comp rx=0 tx=0).stop 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3039190456 shutdown_connections 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a5874a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a586f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3039190456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1e6270 0x55f84a5d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3039190456 >> 172.21.15.153:0/3039190456 conn(0x55f84a1da3c0 msgr2=0x55f84a58c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3039190456 shutdown_connections 2024-09-17T03:13:42.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.144+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3039190456 wait complete. 2024-09-17T03:13:42.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.145+0000 7f4c9bbcd740 1 -- start start 2024-09-17T03:13:42.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.145+0000 7f4c9bbcd740 1 Processor -- start 2024-09-17T03:13:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f84a496330 con 0x55f84a1e6270 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f84a4f3810 con 0x55f84a1c5590 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55f84a260620 con 0x55f84a1bd3b0 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c9bbcd740 10 client.0 _ll_register_callbacks cb 0x55f84a49b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54880/0 (socket says 172.21.15.153:54880) 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 -- 172.21.15.153:0/3116286516 learned_addr learned my addr 172.21.15.153:0/3116286516 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8d400640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 -- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 msgr2=0x55f84a5cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 -- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 msgr2=0x55f84a5d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.147+0000 7f4c8e800640 1 -- 172.21.15.153:0/3116286516 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84a251850 con 0x55f84a1e6270 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c8de00640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009d60 tx=0x7f4c8802c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc647d912151331e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88045040 con 0x55f84a1e6270 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4c88003970 con 0x55f84a1e6270 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c8802cab0 con 0x55f84a1e6270 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4c88056050 con 0x55f84a1e6270 2024-09-17T03:13:42.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c9bbcd740 10 client.4476 fetch_fsmap learned FSMap version 7 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.148+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f84a2c86b0 con 0x55f84a1e6270 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8802cab0 con 0x55f84a1e6270 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f4c88059020 con 0x55f84a1e6270 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 10 client.4476 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 10 client.4476 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 20 client.4476 populate_metadata read hostname 'smithi153' 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a1a4e40 0x55f84a5e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 4 client.4476 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 --> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f84a502520 con 0x55f84a1a4e40 2024-09-17T03:13:42.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.149+0000 7f4c8de00640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a1a4e40 0x55f84a5e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.150+0000 7f4c8de00640 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a1a4e40 0x55f84a5e8cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731ba7686cad2c9 server_cookie=da4d36f21d736a03 in_seq=0 out_seq=0 2024-09-17T03:13:42.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.150+0000 7f4c6ea00640 10 client.4476 ms_handle_connect on v2:172.21.15.164:6835/842621775 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c6ea00640 1 -- 172.21.15.153:0/3116286516 <== mds.0 v2:172.21.15.164:6835/842621775 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f84a502520 con 0x55f84a1a4e40 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c6ea00640 10 client.4476 handle_command_reply: tid=0 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 client.4476 shutdown 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 msgr2=0x55f84a5d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009d60 tx=0x7f4c8802c950 comp rx=0 tx=0).stop 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 shutdown_connections 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a1a4e40 0x55f84a5e8cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5d2820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3116286516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 >> 172.21.15.153:0/3116286516 conn(0x55f84a1da3c0 msgr2=0x55f84a58c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c6ea00640 0 client.4476 ms_handle_reset on v2:172.21.15.164:6835/842621775 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 shutdown_connections 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.151+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3116286516 wait complete. 2024-09-17T03:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.152+0000 7f4c9bbcd740 20 client.4476 trim_cache size 0 max 16384 2024-09-17T03:13:42.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.170+0000 7f4c9bbcd740 1 Processor -- start 2024-09-17T03:13:42.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.170+0000 7f4c9bbcd740 1 -- start start 2024-09-17T03:13:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c901fe1a0 con 0x55f84a1e6270 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900cc0a0 con 0x55f84a1c5590 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4c900cc6f0 con 0x55f84a1bd3b0 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54884/0 (socket says 172.21.15.153:54884) 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8e800640 1 -- 172.21.15.153:0/3618467673 learned_addr learned my addr 172.21.15.153:0/3618467673 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8de00640 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8d400640 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.172+0000 7f4c8e800640 1 -- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 msgr2=0x55f84a5b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.173+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.173+0000 7f4c8e800640 1 -- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 msgr2=0x55f84a5b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.173+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.173+0000 7f4c8e800640 1 -- 172.21.15.153:0/3618467673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84a5cc0b0 con 0x55f84a1e6270 2024-09-17T03:13:42.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.173+0000 7f4c8e800640 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009a60 tx=0x7f4c8802c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09c9c1491264d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.178+0000 7f4c79c00640 1 -- 172.21.15.153:0/3618467673 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8803a020 con 0x55f84a1e6270 2024-09-17T03:13:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.178+0000 7f4c79c00640 1 -- 172.21.15.153:0/3618467673 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8804e070 con 0x55f84a1e6270 2024-09-17T03:13:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.178+0000 7f4c79c00640 1 -- 172.21.15.153:0/3618467673 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88045040 con 0x55f84a1e6270 2024-09-17T03:13:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3618467673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 msgr2=0x55f84a5fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009a60 tx=0x7f4c8802c620 comp rx=0 tx=0).stop 2024-09-17T03:13:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3618467673 shutdown_connections 2024-09-17T03:13:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1e6270 0x55f84a5fa1a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1c5590 0x55f84a5b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/3618467673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1bd3b0 0x55f84a5b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3618467673 >> 172.21.15.153:0/3618467673 conn(0x55f84a1da3c0 msgr2=0x55f84a5ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3618467673 shutdown_connections 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.179+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/3618467673 wait complete. 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.180+0000 7f4c9bbcd740 1 -- start start 2024-09-17T03:13:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.180+0000 7f4c9bbcd740 1 Processor -- start 2024-09-17T03:13:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1bd3b0 0x55f84a5d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1e6270 0x55f84a5f7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f84a5cd570 con 0x55f84a1c5590 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f84a5cca70 con 0x55f84a1bd3b0 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55f84a5d2fe0 con 0x55f84a1e6270 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.181+0000 7f4c9bbcd740 10 client.0 _ll_register_callbacks cb 0x7f4c88043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54890/0 (socket says 172.21.15.153:54890) 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 -- 172.21.15.153:0/807121424 learned_addr learned my addr 172.21.15.153:0/807121424 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8e800640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1e6270 0x55f84a5f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8de00640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1bd3b0 0x55f84a5d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 -- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1e6270 msgr2=0x55f84a5f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1e6270 0x55f84a5f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 -- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1bd3b0 msgr2=0x55f84a5d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1bd3b0 0x55f84a5d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 -- 172.21.15.153:0/807121424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84a5e4a50 con 0x55f84a1c5590 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c8d400640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c90072d40 tx=0x7f4c7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e831acd009ce246f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c6ea00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.182+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c005220 con 0x55f84a1c5590 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4c7c0053c0 con 0x55f84a1c5590 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c8804e070 con 0x55f84a1c5590 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4c7c0055c0 con 0x55f84a1c5590 2024-09-17T03:13:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 10 client.4482 fetch_fsmap learned FSMap version 7 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f84a5cb300 con 0x55f84a1c5590 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8804e070 con 0x55f84a1c5590 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f4c7c035080 con 0x55f84a1c5590 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 10 client.4482 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 10 client.4482 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 20 client.4482 populate_metadata read hostname 'smithi153' 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a5e4570 0x55f84a658a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 4 client.4482 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.183+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 --> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] -- command(tid 0: {"prefix": "status"}) -- 0x55f84a5ce190 con 0x55f84a5e4570 2024-09-17T03:13:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.184+0000 7f4c8de00640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a5e4570 0x55f84a658a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.184+0000 7f4c8de00640 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a5e4570 0x55f84a658a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c004661bc18dcb4 server_cookie=2c418c3355b19215 in_seq=0 out_seq=0 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.184+0000 7f4c6ea00640 10 client.4482 ms_handle_connect on v2:172.21.15.164:6835/842621775 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.184+0000 7f4c6ea00640 1 -- 172.21.15.153:0/807121424 <== mds.0 v2:172.21.15.164:6835/842621775 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55f84a5ce190 con 0x55f84a5e4570 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.184+0000 7f4c6ea00640 10 client.4482 handle_command_reply: tid=0 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 client.4482 shutdown 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 msgr2=0x55f84a6581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c90072d40 tx=0x7f4c7c004730 comp rx=0 tx=0).stop 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 shutdown_connections 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55f84a5e4570 0x55f84a658a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55f84a1e6270 0x55f84a5f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f84a1c5590 0x55f84a6581c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 --2- 172.21.15.153:0/807121424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f84a1bd3b0 0x55f84a5d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c6ea00640 0 client.4482 ms_handle_reset on v2:172.21.15.164:6835/842621775 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 >> 172.21.15.153:0/807121424 conn(0x55f84a1da3c0 msgr2=0x55f84a5ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 shutdown_connections 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 1 -- 172.21.15.153:0/807121424 wait complete. 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.185+0000 7f4c9bbcd740 20 client.4482 trim_cache size 0 max 16384 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:13:42.189 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4371, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 8.0833669879999999, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 7, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 27, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 27, 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 14.11135292 2024-09-17T03:13:42.190 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 msgr2=0x7f4c7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 0x7f4c7007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c9015a130 tx=0x7f4c7c005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 msgr2=0x7f4c900c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c3a0 tx=0x7f4c8000c860 comp rx=0 tx=0).stop 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 shutdown_connections 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c70078b90 0x7f4c7007b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c90156a50 0x7f4c901f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c900cef00 0x7f4c900c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 --2- 172.21.15.153:0/1430098055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c9006ddf0 0x7f4c900c9b60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 >> 172.21.15.153:0/1430098055 conn(0x7f4c900b1b90 msgr2=0x7f4c900b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 shutdown_connections 2024-09-17T03:13:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.186+0000 7f4c94a00640 1 -- 172.21.15.153:0/1430098055 wait complete. 2024-09-17T03:13:42.207 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:13:42.207 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:42.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:13:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 -- 172.21.15.153:0/1476483370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 msgr2=0x7f615015e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 --2- 172.21.15.153:0/1476483370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f615015e4f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6150072820 tx=0x7f614002a560 comp rx=0 tx=0).stop 2024-09-17T03:13:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 -- 172.21.15.153:0/1476483370 shutdown_connections 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 --2- 172.21.15.153:0/1476483370 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6150071160 0x7f6150071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 --2- 172.21.15.153:0/1476483370 >> v2:172.21.15.164:3300/0 conn(0x7f615006dde0 0x7f615006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 --2- 172.21.15.153:0/1476483370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f615015e4f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 -- 172.21.15.153:0/1476483370 >> 172.21.15.153:0/1476483370 conn(0x7f61500d1020 msgr2=0x7f61500d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 -- 172.21.15.153:0/1476483370 shutdown_connections 2024-09-17T03:13:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.428+0000 7f6154a00640 1 -- 172.21.15.153:0/1476483370 wait complete. 2024-09-17T03:13:42.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.430+0000 7f6154a00640 1 Processor -- start 2024-09-17T03:13:42.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.430+0000 7f6154a00640 1 -- start start 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f615006dde0 0x7f6150144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 0x7f61501f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f615015f170 con 0x7f61500b3f50 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f615015eff0 con 0x7f6150071160 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f6154a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f615015f2f0 con 0x7f615006dde0 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54900/0 (socket says 172.21.15.153:54900) 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 -- 172.21.15.153:0/4280467085 learned_addr learned my addr 172.21.15.153:0/4280467085 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614f400640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f615006dde0 0x7f6150144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614ea00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 0x7f61501f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 -- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f615006dde0 msgr2=0x7f6150144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f615006dde0 0x7f6150144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 -- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 msgr2=0x7f61501f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 0x7f61501f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614fe00640 1 -- 172.21.15.153:0/4280467085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6150144000 con 0x7f61500b3f50 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.432+0000 7f614ea00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 0x7f61501f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f614fe00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f614800ea70 tx=0x7f614800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800ce40 con 0x7f61500b3f50 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6148004c10 con 0x7f61500b3f50 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148005020 con 0x7f61500b3f50 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61501f9670 con 0x7f61500b3f50 2024-09-17T03:13:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.433+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61501442c0 con 0x7f61500b3f50 2024-09-17T03:13:42.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.434+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61501f93e0 con 0x7f61500b3f50 2024-09-17T03:13:42.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.435+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61480051c0 con 0x7f61500b3f50 2024-09-17T03:13:42.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.436+0000 7f6147400640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 0x7f613007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:42.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.436+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f614809bd80 con 0x7f61500b3f50 2024-09-17T03:13:42.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.437+0000 7f614f400640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 0x7f613007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:42.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.437+0000 7f614f400640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 0x7f613007b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6140033000 tx=0x7f6140004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:42.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.441+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6148063f10 con 0x7f61500b3f50 2024-09-17T03:13:42.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.659+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f615015f810 con 0x7f61500b3f50 2024-09-17T03:13:42.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.660+0000 7f6147400640 1 -- 172.21.15.153:0/4280467085 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f6148063810 con 0x7f61500b3f50 2024-09-17T03:13:42.659 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:13:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 msgr2=0x7f613007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 0x7f613007b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6140033000 tx=0x7f6140004730 comp rx=0 tx=0).stop 2024-09-17T03:13:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 msgr2=0x7f6150141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f614800ea70 tx=0x7f614800ef30 comp rx=0 tx=0).stop 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 shutdown_connections 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6130078b90 0x7f613007b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61500b3f50 0x7f6150141570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6150071160 0x7f61501f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 --2- 172.21.15.153:0/4280467085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f615006dde0 0x7f6150144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 >> 172.21.15.153:0/4280467085 conn(0x7f61500d1020 msgr2=0x7f615015fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 shutdown_connections 2024-09-17T03:13:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42.662+0000 7f6154a00640 1 -- 172.21.15.153:0/4280467085 wait complete. 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:13:42.683 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:13:42.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:13:42.684 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T03:13:42.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:42.684 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-17T03:13:42.719 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:13:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:42.720 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:13:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:13:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-09-17T03:13:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-17T03:13:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:42.721 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:13:42.722 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:13:42.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:43.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:43.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:43.147 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:13:43.207 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-17T03:13:43.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:43.210 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-17T03:13:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-17T03:13:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:13:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:13:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:13:43.272 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:13:43.273 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:13:43.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:43.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:43.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:43.847 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:13:43.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:43.884 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-17T03:13:43.959 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:43.959 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:13:43.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:43.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-17T03:13:43.960 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:13:44.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:44.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:44.141 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-17T03:13:44.141 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:44.141 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:13:44.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-17T03:13:44.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:13:44.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-17T03:13:44.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-17T03:13:44.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-17T03:13:44.142 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:13:44.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:44.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:44.394 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:44.394 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:13:44.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-17T03:13:44.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:13:44.394 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:13:44.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:44.562 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-17T03:13:44.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:44.563 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:44.599 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T03:13:44.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:44.599 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:44.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-17T03:13:44.772 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-09-17T03:13:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:13:44.811 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:44.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:44.812 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-17T03:13:44.886 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T03:13:44.886 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-17T03:13:44.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-17T03:13:44.987 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-09-17T03:13:45.024 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:13:45.025 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:45.026 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:45.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.027 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-17T03:13:45.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi153.stderr:2024-09-17T03:13:45.157+0000 7f16ffa34480 -1 init, newargv = 0x55935e3e3db0 newargc=15 2024-09-17T03:13:45.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi153.stderr:ceph-fuse[42932]: starting ceph client 2024-09-17T03:13:45.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi153.stderr:ceph-fuse[42932]: starting fuse 2024-09-17T03:13:46.206 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2024-09-17T03:13:46.269 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:13:46.306 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:13:46.307 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:13:46.308 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2024-09-17T03:13:46.309 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:46.309 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:13:46.309 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:46.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.310 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2024-09-17T03:13:46.386 INFO:teuthology.orchestra.run.smithi153.stdout:41 2024-09-17T03:13:46.386 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> import re 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2024-09-17T03:13:46.387 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> return f 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.admin")) 2024-09-17T03:13:46.388 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:13:46.550 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.admin.42932.asok 2024-09-17T03:13:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:46.564 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42932.asok 2024-09-17T03:13:46.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42932.asok status 2024-09-17T03:13:46.806 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "admin", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "42932", 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4494, 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2024-09-17T03:13:46.807 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4494 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 923967343 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:13:46.808 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 923967343 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4494 192.168.0.1:0/923967343", 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "192.168.0.1:0/923967343", 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 7, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 27, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2024-09-17T03:13:46.809 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:13:46.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.823 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2024-09-17T03:13:46.823 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:46.860 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2024-09-17T03:13:46.860 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:46.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:46.957 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-17T03:13:47.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:13:47.066 INFO:teuthology.orchestra.run.smithi153.stdout:# file: . 2024-09-17T03:13:47.066 INFO:teuthology.orchestra.run.smithi153.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-17T03:13:47.066 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:47.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:47.075 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:47.075 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:47.111 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.373+0000 7fd7a1000640 1 -- 172.21.15.153:0/4106835651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c156a50 msgr2=0x7fd79c074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.373+0000 7fd7a1000640 1 --2- 172.21.15.153:0/4106835651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c156a50 0x7fd79c074620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005fd0 tx=0x7fd78c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 -- 172.21.15.153:0/4106835651 shutdown_connections 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 --2- 172.21.15.153:0/4106835651 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c074b60 0x7fd79c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 --2- 172.21.15.153:0/4106835651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c156a50 0x7fd79c074620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 -- 172.21.15.153:0/4106835651 >> 172.21.15.153:0/4106835651 conn(0x7fd79c0b1b90 msgr2=0x7fd79c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 -- 172.21.15.153:0/4106835651 shutdown_connections 2024-09-17T03:13:47.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.374+0000 7fd7a1000640 1 -- 172.21.15.153:0/4106835651 wait complete. 2024-09-17T03:13:47.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.376+0000 7fd7a1000640 1 Processor -- start 2024-09-17T03:13:47.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.376+0000 7fd7a1000640 1 -- start start 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.377+0000 7fd7a1000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 0x7fd79c1e6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd7a1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd7a1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd79c156a50 0x7fd79c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd7a1000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0ce500 con 0x7fd79c074b60 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd7a1000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0ce380 con 0x7fd79c156a50 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd7a1000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0ce680 con 0x7fd79c06e330 2024-09-17T03:13:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56882/0 (socket says 172.21.15.153:56882) 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 -- 172.21.15.153:0/496200706 learned_addr learned my addr 172.21.15.153:0/496200706 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799e00640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 0x7fd79c1e6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd79a800640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd79c156a50 0x7fd79c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 -- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 msgr2=0x7fd79c1e6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 0x7fd79c1e6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 -- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd79c156a50 msgr2=0x7fd79c0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd79c156a50 0x7fd79c0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799400640 1 -- 172.21.15.153:0/496200706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c1f6380 con 0x7fd79c074b60 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.378+0000 7fd799e00640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 0x7fd79c1e6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd799400640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd78800e790 tx=0x7fd78800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78800eea0 con 0x7fd79c074b60 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd78800cdb0 con 0x7fd79c074b60 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c0b5be0 con 0x7fd79c074b60 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788010690 con 0x7fd79c074b60 2024-09-17T03:13:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.379+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c1e6310 con 0x7fd79c074b60 2024-09-17T03:13:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.380+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79c0b5950 con 0x7fd79c074b60 2024-09-17T03:13:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.382+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd788010830 con 0x7fd79c074b60 2024-09-17T03:13:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.382+0000 7fd792000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 0x7fd77c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.383+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd78809bb70 con 0x7fd79c074b60 2024-09-17T03:13:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.383+0000 7fd799e00640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 0x7fd77c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.384+0000 7fd799e00640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 0x7fd77c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd78c035000 tx=0x7fd78c038040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.388+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd79c1f6380 con 0x7fd79c074b60 2024-09-17T03:13:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.583+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd79c1e5e20 con 0x7fd79c074b60 2024-09-17T03:13:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.583+0000 7fd792000640 1 -- 172.21.15.153:0/496200706 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd788063bd0 con 0x7fd79c074b60 2024-09-17T03:13:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.585+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 msgr2=0x7fd77c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.585+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 0x7fd77c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd78c035000 tx=0x7fd78c038040 comp rx=0 tx=0).stop 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.585+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 msgr2=0x7fd79c1f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.585+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd78800e790 tx=0x7fd78800ec50 comp rx=0 tx=0).stop 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 shutdown_connections 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd77c078b90 0x7fd77c07b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd79c156a50 0x7fd79c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd79c074b60 0x7fd79c1f5e40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 --2- 172.21.15.153:0/496200706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd79c06e330 0x7fd79c1e6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 >> 172.21.15.153:0/496200706 conn(0x7fd79c0b1b90 msgr2=0x7fd79c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 shutdown_connections 2024-09-17T03:13:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.586+0000 7fd7a1000640 1 -- 172.21.15.153:0/496200706 wait complete. 2024-09-17T03:13:47.607 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:13:47.607 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:47.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:13:47.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 -- 172.21.15.153:0/2931528147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc0702a0 msgr2=0x7f12dc0cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 --2- 172.21.15.153:0/2931528147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc0702a0 0x7f12dc0cf6d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12d4005fd0 tx=0x7f12d402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 -- 172.21.15.153:0/2931528147 shutdown_connections 2024-09-17T03:13:47.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 --2- 172.21.15.153:0/2931528147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc0702a0 0x7f12dc0cf6d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 -- 172.21.15.153:0/2931528147 >> 172.21.15.153:0/2931528147 conn(0x7f12dc0d05c0 msgr2=0x7f12dc06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 -- 172.21.15.153:0/2931528147 shutdown_connections 2024-09-17T03:13:47.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.904+0000 7f12e1600640 1 -- 172.21.15.153:0/2931528147 wait complete. 2024-09-17T03:13:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.906+0000 7f12e1600640 1 Processor -- start 2024-09-17T03:13:47.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.906+0000 7f12e1600640 1 -- start start 2024-09-17T03:13:47.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12dc0702a0 0x7f12dc1e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12dc0cc0e0 0x7f12dc13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc0b3e60 con 0x7f12dc1f81e0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc0b3ce0 con 0x7f12dc0cc0e0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e1600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc0b3fe0 con 0x7f12dc0702a0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56908/0 (socket says 172.21.15.153:56908) 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12e0c00640 1 -- 172.21.15.153:0/3755797958 learned_addr learned my addr 172.21.15.153:0/3755797958 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12dbe00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12dc0702a0 0x7f12dc1e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.908+0000 7f12d3400640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12dc0cc0e0 0x7f12dc13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 -- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12dc0702a0 msgr2=0x7f12dc1e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12dc0702a0 0x7f12dc1e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 -- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12dc0cc0e0 msgr2=0x7f12dc13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12dc0cc0e0 0x7f12dc13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 -- 172.21.15.153:0/3755797958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc1f8b30 con 0x7f12dc1f81e0 2024-09-17T03:13:47.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e0c00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006010 tx=0x7f12d4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4031b90 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12d4031e20 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc1e8c10 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.909+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40332f0 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.910+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc1e6f80 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.911+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc1e6a10 con 0x7f12dc1f81e0 2024-09-17T03:13:47.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.912+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12d4031660 con 0x7f12dc1f81e0 2024-09-17T03:13:47.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.913+0000 7f12d8c00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 0x7f12b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.913+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f12d40bc710 con 0x7f12dc1f81e0 2024-09-17T03:13:47.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.913+0000 7f12dbe00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 0x7f12b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.914+0000 7f12dbe00640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 0x7f12b807b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f60 tx=0x7f12cc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:47.917+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12dc1f8b30 con 0x7f12dc1f81e0 2024-09-17T03:13:48.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.114+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f12dc15f4e0 con 0x7f12dc1f81e0 2024-09-17T03:13:48.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.114+0000 7f12d8c00640 1 -- 172.21.15.153:0/3755797958 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f12d403f030 con 0x7f12dc1f81e0 2024-09-17T03:13:48.114 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 msgr2=0x7f12b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 0x7f12b807b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f60 tx=0x7f12cc009040 comp rx=0 tx=0).stop 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 msgr2=0x7f12dc1f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006010 tx=0x7f12d4003ba0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 shutdown_connections 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f12b8078bc0 0x7f12b807b0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12dc1f81e0 0x7f12dc1f85f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12dc0cc0e0 0x7f12dc13ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 --2- 172.21.15.153:0/3755797958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12dc0702a0 0x7f12dc1e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 >> 172.21.15.153:0/3755797958 conn(0x7f12dc0d05c0 msgr2=0x7f12dc1458d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:48.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 shutdown_connections 2024-09-17T03:13:48.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.117+0000 7f12e1600640 1 -- 172.21.15.153:0/3755797958 wait complete. 2024-09-17T03:13:48.136 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2024-09-17T03:13:48.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:48.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:13:48.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi153.stderr:ceph-fuse[42932]: fuse finished with error 0 and tester_r 0 2024-09-17T03:13:48.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:13:48.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:13:48.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:48.274 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-17T03:13:48.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.544+0000 7f6487a00640 1 -- 172.21.15.153:0/2661359333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480073dd0 msgr2=0x7f648006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.544+0000 7f6487a00640 1 --2- 172.21.15.153:0/2661359333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480073dd0 0x7f648006ddf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6468009830 tx=0x7f646802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.545+0000 7f6487a00640 1 -- 172.21.15.153:0/2661359333 shutdown_connections 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.545+0000 7f6487a00640 1 --2- 172.21.15.153:0/2661359333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480073dd0 0x7f648006ddf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.545+0000 7f6487a00640 1 -- 172.21.15.153:0/2661359333 >> 172.21.15.153:0/2661359333 conn(0x7f64800cca40 msgr2=0x7f64800cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.545+0000 7f6487a00640 1 -- 172.21.15.153:0/2661359333 shutdown_connections 2024-09-17T03:13:48.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.545+0000 7f6487a00640 1 -- 172.21.15.153:0/2661359333 wait complete. 2024-09-17T03:13:48.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.547+0000 7f6487a00640 1 Processor -- start 2024-09-17T03:13:48.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.547+0000 7f6487a00640 1 -- start start 2024-09-17T03:13:48.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6480073dd0 0x7f64801f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480074cb0 0x7f64800c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f648006f670 con 0x7f648006e330 2024-09-17T03:13:48.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f648006f4f0 con 0x7f6480074cb0 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.548+0000 7f6487a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f648006f7f0 con 0x7f6480073dd0 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56920/0 (socket says 172.21.15.153:56920) 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 -- 172.21.15.153:0/4244641415 learned_addr learned my addr 172.21.15.153:0/4244641415 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480074cb0 0x7f64800c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6477e00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6480073dd0 0x7f64801f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 -- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6480073dd0 msgr2=0x7f64801f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6480073dd0 0x7f64801f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 -- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480074cb0 msgr2=0x7f64800c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480074cb0 0x7f64800c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.549+0000 7f6485000640 1 -- 172.21.15.153:0/4244641415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64801f5580 con 0x7f648006e330 2024-09-17T03:13:48.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f6485000640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6470001eb0 tx=0x7f647000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470017070 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64700053c0 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470003830 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648009f100 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.550+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648009f6c0 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.551+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648006ddf0 con 0x7f648006e330 2024-09-17T03:13:48.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.552+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f647001a070 con 0x7f648006e330 2024-09-17T03:13:48.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.553+0000 7f647d600640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 0x7f645c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.553+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f647009a440 con 0x7f648006e330 2024-09-17T03:13:48.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.554+0000 7f6477e00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 0x7f645c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.555+0000 7f6477e00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 0x7f645c07b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6468034000 tx=0x7f6468004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.558+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f648006e740 con 0x7f648006e330 2024-09-17T03:13:48.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.744+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64800b5ec0 con 0x7f648006e330 2024-09-17T03:13:48.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.745+0000 7f647d600640 1 -- 172.21.15.153:0/4244641415 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f6470061e60 con 0x7f648006e330 2024-09-17T03:13:48.745 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:48.745 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 msgr2=0x7f645c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 0x7f645c07b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6468034000 tx=0x7f6468004730 comp rx=0 tx=0).stop 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 msgr2=0x7f64800cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6470001eb0 tx=0x7f647000c890 comp rx=0 tx=0).stop 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 shutdown_connections 2024-09-17T03:13:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f645c078b90 0x7f645c07b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6480074cb0 0x7f64800c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6480073dd0 0x7f64801f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 --2- 172.21.15.153:0/4244641415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f648006e330 0x7f64800cf7c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 >> 172.21.15.153:0/4244641415 conn(0x7f64800cca40 msgr2=0x7f6480068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 shutdown_connections 2024-09-17T03:13:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.748+0000 7f6487a00640 1 -- 172.21.15.153:0/4244641415 wait complete. 2024-09-17T03:13:48.769 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 -- 172.21.15.153:0/1293991379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300cca50 msgr2=0x7f36300cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 --2- 172.21.15.153:0/1293991379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300cca50 0x7f36300cce60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3618009830 tx=0x7f361802a510 comp rx=0 tx=0).stop 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 -- 172.21.15.153:0/1293991379 shutdown_connections 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 --2- 172.21.15.153:0/1293991379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300cca50 0x7f36300cce60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 --2- 172.21.15.153:0/1293991379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 0x7f363015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 -- 172.21.15.153:0/1293991379 >> 172.21.15.153:0/1293991379 conn(0x7f363006f940 msgr2=0x7f36300b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 -- 172.21.15.153:0/1293991379 shutdown_connections 2024-09-17T03:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.990+0000 7f3634a00640 1 -- 172.21.15.153:0/1293991379 wait complete. 2024-09-17T03:13:48.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.992+0000 7f3634a00640 1 Processor -- start 2024-09-17T03:13:48.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.993+0000 7f3634a00640 1 -- start start 2024-09-17T03:13:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 0x7f363015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 0x7f36301f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36300ce840 con 0x7f3630155150 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f36300ce6c0 con 0x7f36300cca50 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f3634a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f36300ce9c0 con 0x7f36300af000 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f362fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f362fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56944/0 (socket says 172.21.15.153:56944) 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.994+0000 7f362fe00640 1 -- 172.21.15.153:0/1101252211 learned_addr learned my addr 172.21.15.153:0/1101252211 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362f400640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 0x7f363015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f3627e00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 0x7f36301f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 -- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 msgr2=0x7f363015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 0x7f363015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 -- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 msgr2=0x7f36301f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 0x7f36301f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 -- 172.21.15.153:0/1101252211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363015a140 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f3627e00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 0x7f36301f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f362fe00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f362800c6c0 tx=0x7f362800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628017070 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3628003c60 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.995+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36280052d0 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.996+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363015a3c0 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.996+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363015a980 con 0x7f3630155150 2024-09-17T03:13:48.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.997+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363015f790 con 0x7f3630155150 2024-09-17T03:13:48.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.998+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f362801a070 con 0x7f3630155150 2024-09-17T03:13:48.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.999+0000 7f3627400640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 0x7f360c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:48.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.999+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f362809a600 con 0x7f3630155150 2024-09-17T03:13:48.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:48.999+0000 7f362f400640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 0x7f360c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:48.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.000+0000 7f362f400640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 0x7f360c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3620009b30 tx=0x7f3620005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:49.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.003+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f363015a140 con 0x7f3630155150 2024-09-17T03:13:49.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.189+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f363015bfe0 con 0x7f3630155150 2024-09-17T03:13:49.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.190+0000 7f3627400640 1 -- 172.21.15.153:0/1101252211 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f36280620a0 con 0x7f3630155150 2024-09-17T03:13:49.189 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:49.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 msgr2=0x7f360c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 0x7f360c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3620009b30 tx=0x7f3620005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:49.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 msgr2=0x7f363015b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f362800c6c0 tx=0x7f362800cb80 comp rx=0 tx=0).stop 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 shutdown_connections 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f360c078b90 0x7f360c07b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630155150 0x7f363015b180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36300cca50 0x7f36301f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 --2- 172.21.15.153:0/1101252211 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36300af000 0x7f363015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 >> 172.21.15.153:0/1101252211 conn(0x7f363006f940 msgr2=0x7f3630154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 shutdown_connections 2024-09-17T03:13:49.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.193+0000 7f3634a00640 1 -- 172.21.15.153:0/1101252211 wait complete. 2024-09-17T03:13:49.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:13:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 -- 172.21.15.153:0/258259151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 msgr2=0x7f7584005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 --2- 172.21.15.153:0/258259151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f7584005190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75940017c0 tx=0x7f7584005830 comp rx=0 tx=0).stop 2024-09-17T03:13:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2400640 1 -- 172.21.15.153:0/258259151 reap_dead start 2024-09-17T03:13:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 -- 172.21.15.153:0/258259151 shutdown_connections 2024-09-17T03:13:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 -- 172.21.15.153:0/258259151 >> 172.21.15.153:0/258259151 conn(0x7f759c0d1020 msgr2=0x7f759c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 -- 172.21.15.153:0/258259151 shutdown_connections 2024-09-17T03:13:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.442+0000 7f75a2e00640 1 -- 172.21.15.153:0/258259151 wait complete. 2024-09-17T03:13:49.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.445+0000 7f75a2e00640 1 Processor -- start 2024-09-17T03:13:49.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.445+0000 7f75a2e00640 1 -- start start 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f759c157520 0x7f759c157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f759c0c6840 0x7f759c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f759c06edb0 con 0x7f7584004d40 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f759c06ec30 con 0x7f759c157520 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a2e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f759c0b3f50 con 0x7f759c0c6840 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56966/0 (socket says 172.21.15.153:56966) 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.446+0000 7f75a1a00640 1 -- 172.21.15.153:0/1004031943 learned_addr learned my addr 172.21.15.153:0/1004031943 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a2400640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f759c0c6840 0x7f759c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1000640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f759c157520 0x7f759c157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 -- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f759c0c6840 msgr2=0x7f759c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f759c0c6840 0x7f759c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 -- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f759c157520 msgr2=0x7f759c157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f759c157520 0x7f759c157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 -- 172.21.15.153:0/1004031943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0c7190 con 0x7f7584004d40 2024-09-17T03:13:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f75a1a00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7590001be0 tx=0x7f75900066e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.447+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590015070 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.448+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f759000fb30 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.448+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590011430 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.448+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c1580e0 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.448+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c1586a0 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.449+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c0b44b0 con 0x7f7584004d40 2024-09-17T03:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.450+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75900115d0 con 0x7f7584004d40 2024-09-17T03:13:49.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.451+0000 7f7599600640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 0x7f757c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.451+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f759009bf70 con 0x7f7584004d40 2024-09-17T03:13:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.451+0000 7f75a1000640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 0x7f757c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.452+0000 7f75a1000640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 0x7f757c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f759c06f9b0 tx=0x7f7588005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:49.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.455+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f759c0c7190 con 0x7f7584004d40 2024-09-17T03:13:49.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:49.675+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f759c0b4a00 con 0x7f7584004d40 2024-09-17T03:13:50.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.209+0000 7f7599600640 1 -- 172.21.15.153:0/1004031943 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f7590063980 con 0x7f7584004d40 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 msgr2=0x7f757c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 0x7f757c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f759c06f9b0 tx=0x7f7588005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 msgr2=0x7f759c1f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7590001be0 tx=0x7f75900066e0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 shutdown_connections 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f757c078b90 0x7f757c07b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f759c0c6840 0x7f759c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f759c157520 0x7f759c157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 --2- 172.21.15.153:0/1004031943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7584004d40 0x7f759c1f3400 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 >> 172.21.15.153:0/1004031943 conn(0x7f759c0d1020 msgr2=0x7f759c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 shutdown_connections 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.213+0000 7f75a2e00640 1 -- 172.21.15.153:0/1004031943 wait complete. 2024-09-17T03:13:50.237 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-17T03:13:50.237 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:13:50.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 -- 172.21.15.153:0/3106606697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8071870 msgr2=0x7f28d806cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 --2- 172.21.15.153:0/3106606697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8071870 0x7f28d806cee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28d0005fd0 tx=0x7f28d002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 -- 172.21.15.153:0/3106606697 shutdown_connections 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 --2- 172.21.15.153:0/3106606697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8071870 0x7f28d806cee0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 --2- 172.21.15.153:0/3106606697 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8160980 0x7f28d8145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 -- 172.21.15.153:0/3106606697 >> 172.21.15.153:0/3106606697 conn(0x7f28d80d1020 msgr2=0x7f28d80d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 -- 172.21.15.153:0/3106606697 shutdown_connections 2024-09-17T03:13:50.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.464+0000 7f28dee00640 1 -- 172.21.15.153:0/3106606697 wait complete. 2024-09-17T03:13:50.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.466+0000 7f28dee00640 1 Processor -- start 2024-09-17T03:13:50.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.467+0000 7f28dee00640 1 -- start start 2024-09-17T03:13:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d8145580 0x7f28d8073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8143cb0 0x7f28d81440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28d806da20 con 0x7f28d8160980 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f28d806d8a0 con 0x7f28d8145580 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dee00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f28d806dba0 con 0x7f28d8143cb0 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56990/0 (socket says 172.21.15.153:56990) 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.468+0000 7f28dd000640 1 -- 172.21.15.153:0/4097988121 learned_addr learned my addr 172.21.15.153:0/4097988121 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28de400640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8143cb0 0x7f28d81440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dda00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d8145580 0x7f28d8073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 -- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8143cb0 msgr2=0x7f28d81440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8143cb0 0x7f28d81440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 -- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d8145580 msgr2=0x7f28d8073cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d8145580 0x7f28d8073cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 -- 172.21.15.153:0/4097988121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d8143800 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dd000640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007fd0 tx=0x7f28c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4011790 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28c4017070 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4011d20 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.469+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81f5160 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.470+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d81f5720 con 0x7f28d8160980 2024-09-17T03:13:50.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.471+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d81f4ed0 con 0x7f28d8160980 2024-09-17T03:13:50.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.472+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28c401c460 con 0x7f28d8160980 2024-09-17T03:13:50.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.473+0000 7f28d5600640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 0x7f28b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.473+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f28c409ae60 con 0x7f28d8160980 2024-09-17T03:13:50.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.473+0000 7f28dda00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 0x7f28b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.474+0000 7f28dda00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 0x7f28b807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009ac0 tx=0x7f28cc005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.477+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28c4062ec0 con 0x7f28d8160980 2024-09-17T03:13:50.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:50.697+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f28d806e0c0 con 0x7f28d8160980 2024-09-17T03:13:51.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.216+0000 7f28d5600640 1 -- 172.21.15.153:0/4097988121 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f28c40627c0 con 0x7f28d8160980 2024-09-17T03:13:51.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 msgr2=0x7f28b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 0x7f28b807b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009ac0 tx=0x7f28cc005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:51.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 msgr2=0x7f28d8074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007fd0 tx=0x7f28c400c890 comp rx=0 tx=0).stop 2024-09-17T03:13:51.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 shutdown_connections 2024-09-17T03:13:51.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f28b8078b90 0x7f28b807b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d8143cb0 0x7f28d81440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d8160980 0x7f28d8074200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 --2- 172.21.15.153:0/4097988121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d8145580 0x7f28d8073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 >> 172.21.15.153:0/4097988121 conn(0x7f28d80d1020 msgr2=0x7f28d80b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 shutdown_connections 2024-09-17T03:13:51.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.219+0000 7f28dee00640 1 -- 172.21.15.153:0/4097988121 wait complete. 2024-09-17T03:13:51.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:13:51.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.462+0000 7fd3c2400640 1 -- 172.21.15.153:0/3583286813 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 msgr2=0x7fd3bc073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.462+0000 7fd3c2400640 1 --2- 172.21.15.153:0/3583286813 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc073dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009860 tx=0x7fd3ac02a5a0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.462+0000 7fd3c2400640 1 -- 172.21.15.153:0/3583286813 shutdown_connections 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.462+0000 7fd3c2400640 1 --2- 172.21.15.153:0/3583286813 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc073dd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.463+0000 7fd3c2400640 1 -- 172.21.15.153:0/3583286813 >> 172.21.15.153:0/3583286813 conn(0x7fd3bc0cca40 msgr2=0x7fd3bc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.463+0000 7fd3c2400640 1 -- 172.21.15.153:0/3583286813 shutdown_connections 2024-09-17T03:13:51.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.463+0000 7fd3c2400640 1 -- 172.21.15.153:0/3583286813 wait complete. 2024-09-17T03:13:51.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.465+0000 7fd3c2400640 1 Processor -- start 2024-09-17T03:13:51.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.465+0000 7fd3c2400640 1 -- start start 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc0a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc09d810 0x7fd3bc1e6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc06f670 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc06f4f0 con 0x7fd3bc09d810 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.466+0000 7fd3c2400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc06f7f0 con 0x7fd3bc074cb0 2024-09-17T03:13:51.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57000/0 (socket says 172.21.15.153:57000) 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 -- 172.21.15.153:0/1212987945 learned_addr learned my addr 172.21.15.153:0/1212987945 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3bb400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc0a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3bbe00640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc09d810 0x7fd3bc1e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 -- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 msgr2=0x7fd3bc0a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc0a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 -- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc09d810 msgr2=0x7fd3bc1e6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc09d810 0x7fd3bc1e6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 -- 172.21.15.153:0/1212987945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc156bd0 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3bb400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc0a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:51.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.467+0000 7fd3b2a00640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c430 tx=0x7fd3a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.468+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4017070 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.468+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3a40053e0 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.468+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003850 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.468+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc156eb0 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.468+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc157470 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.469+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc073dd0 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.470+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3a401a070 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.471+0000 7fd3b3e00640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 0x7fd39807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.471+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd3a409a580 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.471+0000 7fd3bb400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 0x7fd39807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.472+0000 7fd3bb400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 0x7fd39807b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac034000 tx=0x7fd3ac004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:51.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.475+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3a4062560 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.697+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3bc1e6020 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.697+0000 7fd3b3e00640 1 -- 172.21.15.153:0/1212987945 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fd3a4061e60 con 0x7fd3bc0cbc10 2024-09-17T03:13:51.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:13:51.697 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 msgr2=0x7fd39807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 0x7fd39807b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac034000 tx=0x7fd3ac004730 comp rx=0 tx=0).stop 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 msgr2=0x7fd3bc0a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c430 tx=0x7fd3a400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 shutdown_connections 2024-09-17T03:13:51.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd398078bc0 0x7fd39807b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3bc09d810 0x7fd3bc1e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3bc0cbc10 0x7fd3bc0a0860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 --2- 172.21.15.153:0/1212987945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3bc074cb0 0x7fd3bc0a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 >> 172.21.15.153:0/1212987945 conn(0x7fd3bc0cca40 msgr2=0x7fd3bc159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 shutdown_connections 2024-09-17T03:13:51.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.700+0000 7fd3c2400640 1 -- 172.21.15.153:0/1212987945 wait complete. 2024-09-17T03:13:51.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 -- 172.21.15.153:0/1956319953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14bc004800 msgr2=0x7f14bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 --2- 172.21.15.153:0/1956319953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14bc004800 0x7f14bc004c10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c390 tx=0x7f14bc005830 comp rx=0 tx=0).stop 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14da200640 1 -- 172.21.15.153:0/1956319953 reap_dead start 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 -- 172.21.15.153:0/1956319953 shutdown_connections 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 -- 172.21.15.153:0/1956319953 >> 172.21.15.153:0/1956319953 conn(0x7f14d40cca40 msgr2=0x7f14d40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 -- 172.21.15.153:0/1956319953 shutdown_connections 2024-09-17T03:13:51.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.943+0000 7f14dc200640 1 -- 172.21.15.153:0/1956319953 wait complete. 2024-09-17T03:13:51.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.946+0000 7f14dc200640 1 Processor -- start 2024-09-17T03:13:51.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.946+0000 7f14dc200640 1 -- start start 2024-09-17T03:13:51.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14bc004800 0x7f14d409cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14d41581c0 0x7f14d406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40cc1a0 con 0x7f14d4157db0 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f14d40cc020 con 0x7f14bc004800 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14dc200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f14d40cc320 con 0x7f14d41581c0 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14d8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14d8e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57008/0 (socket says 172.21.15.153:57008) 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.947+0000 7f14d8e00640 1 -- 172.21.15.153:0/2343932695 learned_addr learned my addr 172.21.15.153:0/2343932695 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14da200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14d41581c0 0x7f14d406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d9800640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14bc004800 0x7f14d409cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 -- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14d41581c0 msgr2=0x7f14d406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14d41581c0 0x7f14d406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 -- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14bc004800 msgr2=0x7f14d409cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14bc004800 0x7f14d409cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:51.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 -- 172.21.15.153:0/2343932695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d409f1a0 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d8e00640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14c002b190 tx=0x7f14c0006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0042070 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14c00017a0 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.948+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d409f610 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.949+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0039070 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.949+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d409fbd0 con 0x7f14d4157db0 2024-09-17T03:13:51.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.950+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d406f720 con 0x7f14d4157db0 2024-09-17T03:13:51.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.951+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14c0045070 con 0x7f14d4157db0 2024-09-17T03:13:51.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.952+0000 7f14d1600640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:51.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.952+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f14c00ba990 con 0x7f14d4157db0 2024-09-17T03:13:51.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.952+0000 7f14d9800640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:51.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.953+0000 7f14d9800640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 0x7f14b407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14d415a730 tx=0x7f14c8009500 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:51.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:51.956+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14c0030030 con 0x7f14d4157db0 2024-09-17T03:13:52.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.143+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14d409f370 con 0x7f14d4157db0 2024-09-17T03:13:52.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.144+0000 7f14d1600640 1 -- 172.21.15.153:0/2343932695 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f14c0082420 con 0x7f14d4157db0 2024-09-17T03:13:52.143 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:52.144 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:52.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 msgr2=0x7f14b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 0x7f14b407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14d415a730 tx=0x7f14c8009500 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 msgr2=0x7f14d406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14c002b190 tx=0x7f14c0006d50 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 shutdown_connections 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f14b4078b90 0x7f14b407b0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14d41581c0 0x7f14d406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14d4157db0 0x7f14d406d380 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 --2- 172.21.15.153:0/2343932695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14bc004800 0x7f14d409cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 >> 172.21.15.153:0/2343932695 conn(0x7f14d40cca40 msgr2=0x7f14d415f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 shutdown_connections 2024-09-17T03:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.147+0000 7f14dc200640 1 -- 172.21.15.153:0/2343932695 wait complete. 2024-09-17T03:13:52.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:13:52.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:52.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 -- 172.21.15.153:0/52487308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 msgr2=0x7f8ee8004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 --2- 172.21.15.153:0/52487308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8ee8004080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001830 tx=0x7f8ee8005830 comp rx=0 tx=0).stop 2024-09-17T03:13:52.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 -- 172.21.15.153:0/52487308 shutdown_connections 2024-09-17T03:13:52.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 --2- 172.21.15.153:0/52487308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8ee8004080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 -- 172.21.15.153:0/52487308 >> 172.21.15.153:0/52487308 conn(0x7f8f040d0d40 msgr2=0x7f8f040d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:52.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 -- 172.21.15.153:0/52487308 shutdown_connections 2024-09-17T03:13:52.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.394+0000 7f8f09000640 1 -- 172.21.15.153:0/52487308 wait complete. 2024-09-17T03:13:52.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.396+0000 7f8f09000640 1 Processor -- start 2024-09-17T03:13:52.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.396+0000 7f8f09000640 1 -- start start 2024-09-17T03:13:52.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f041504e0 0x7f8f040cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f040ccd10 0x7f8f040ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0415e5c0 con 0x7f8ee8003c30 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0415e440 con 0x7f8f040ccd10 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f09000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0415e740 con 0x7f8f041504e0 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57020/0 (socket says 172.21.15.153:57020) 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 -- 172.21.15.153:0/1586685501 learned_addr learned my addr 172.21.15.153:0/1586685501 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8efaa00640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f041504e0 0x7f8f040cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03e00640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f040ccd10 0x7f8f040ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 -- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f041504e0 msgr2=0x7f8f040cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f041504e0 0x7f8f040cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 -- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f040ccd10 msgr2=0x7f8f040ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.398+0000 7f8f03400640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f040ccd10 0x7f8f040ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8f03400640 1 -- 172.21.15.153:0/1586685501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f040cd120 con 0x7f8ee8003c30 2024-09-17T03:13:52.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8f03400640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001950 tx=0x7f8ef40060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:52.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4043070 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ef40038e0 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4003d30 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f041f8c70 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.399+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f041f9230 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.401+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0406e020 con 0x7f8ee8003c30 2024-09-17T03:13:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.402+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ef4033480 con 0x7f8ee8003c30 2024-09-17T03:13:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.403+0000 7f8efbe00640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 0x7f8ee007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.403+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8ef40baf10 con 0x7f8ee8003c30 2024-09-17T03:13:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.404+0000 7f8efaa00640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 0x7f8ee007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.404+0000 7f8efaa00640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 0x7f8ee007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f04151030 tx=0x7f8eec005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:52.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.408+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f040cd120 con 0x7f8ee8003c30 2024-09-17T03:13:52.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:52.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:52.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.598+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f040ce920 con 0x7f8ee0078b90 2024-09-17T03:13:52.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.606+0000 7f8efbe00640 1 -- 172.21.15.153:0/1586685501 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332542 (secure 0 0 0) 0x7f8eec072310 con 0x7f8ee0078b90 2024-09-17T03:13:52.609 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:52.611 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 msgr2=0x7f8ee007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 0x7f8ee007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f04151030 tx=0x7f8eec005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 msgr2=0x7f8f041f8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001950 tx=0x7f8ef40060e0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 shutdown_connections 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ee0078b90 0x7f8ee007b0a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f040ccd10 0x7f8f040ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f041504e0 0x7f8f040cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 --2- 172.21.15.153:0/1586685501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ee8003c30 0x7f8f041f8370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 >> 172.21.15.153:0/1586685501 conn(0x7f8f040d0d40 msgr2=0x7f8f0415da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:52.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 shutdown_connections 2024-09-17T03:13:52.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.611+0000 7f8f09000640 1 -- 172.21.15.153:0/1586685501 wait complete. 2024-09-17T03:13:52.632 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-17T03:13:50.820789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593227,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":147,"num_write_kb":1643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219692,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755028,"statfs":{"total":773094113280,"available":772869148672,"internally_reserved":0,"allocated":3514368,"data_stored":2077950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.665595"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160943+0000","last_change":"2024-09-17T03:13:33.123350+0000","last_active":"2024-09-17T03:13:39.160943+0000","last_peered":"2024-09-17T03:13:39.160943+0000","last_clean":"2024-09-17T03:13:39.160943+0000","last_became_active":"2024-09-17T03:13:33.122982+0000","last_became_peered":"2024-09-17T03:13:33.122982+0000","last_unstale":"2024-09-17T03:13:39.160943+0000","last_undegraded":"2024-09-17T03:13:39.160943+0000","last_fullsized":"2024-09-17T03:13:39.160943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.030877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159339+0000","last_change":"2024-09-17T03:13:34.133910+0000","last_active":"2024-09-17T03:13:39.159339+0000","last_peered":"2024-09-17T03:13:39.159339+0000","last_clean":"2024-09-17T03:13:39.159339+0000","last_became_active":"2024-09-17T03:13:34.133495+0000","last_became_peered":"2024-09-17T03:13:34.133495+0000","last_unstale":"2024-09-17T03:13:39.159339+0000","last_undegraded":"2024-09-17T03:13:39.159339+0000","last_fullsized":"2024-09-17T03:13:39.159339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:06.942420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194823+0000","last_change":"2024-09-17T03:13:38.178584+0000","last_active":"2024-09-17T03:13:39.194823+0000","last_peered":"2024-09-17T03:13:39.194823+0000","last_clean":"2024-09-17T03:13:39.194823+0000","last_became_active":"2024-09-17T03:13:38.176304+0000","last_became_peered":"2024-09-17T03:13:38.176304+0000","last_unstale":"2024-09-17T03:13:39.194823+0000","last_undegraded":"2024-09-17T03:13:39.194823+0000","last_fullsized":"2024-09-17T03:13:39.194823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:12.541698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159446+0000","last_change":"2024-09-17T03:13:33.127434+0000","last_active":"2024-09-17T03:13:39.159446+0000","last_peered":"2024-09-17T03:13:39.159446+0000","last_clean":"2024-09-17T03:13:39.159446+0000","last_became_active":"2024-09-17T03:13:33.127048+0000","last_became_peered":"2024-09-17T03:13:33.127048+0000","last_unstale":"2024-09-17T03:13:39.159446+0000","last_undegraded":"2024-09-17T03:13:39.159446+0000","last_fullsized":"2024-09-17T03:13:39.159446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159903+0000","last_change":"2024-09-17T03:13:34.133739+0000","last_active":"2024-09-17T03:13:39.159903+0000","last_peered":"2024-09-17T03:13:39.159903+0000","last_clean":"2024-09-17T03:13:39.159903+0000","last_became_active":"2024-09-17T03:13:34.132902+0000","last_became_peered":"2024-09-17T03:13:34.132902+0000","last_unstale":"2024-09-17T03:13:39.159903+0000","last_undegraded":"2024-09-17T03:13:39.159903+0000","last_fullsized":"2024-09-17T03:13:39.159903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194767+0000","last_change":"2024-09-17T03:13:38.169585+0000","last_active":"2024-09-17T03:13:39.194767+0000","last_peered":"2024-09-17T03:13:39.194767+0000","last_clean":"2024-09-17T03:13:39.194767+0000","last_became_active":"2024-09-17T03:13:38.169149+0000","last_became_peered":"2024-09-17T03:13:38.169149+0000","last_unstale":"2024-09-17T03:13:39.194767+0000","last_undegraded":"2024-09-17T03:13:39.194767+0000","last_fullsized":"2024-09-17T03:13:39.194767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.817523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197699+0000","last_change":"2024-09-17T03:13:33.136982+0000","last_active":"2024-09-17T03:13:39.197699+0000","last_peered":"2024-09-17T03:13:39.197699+0000","last_clean":"2024-09-17T03:13:39.197699+0000","last_became_active":"2024-09-17T03:13:33.136263+0000","last_became_peered":"2024-09-17T03:13:33.136263+0000","last_unstale":"2024-09-17T03:13:39.197699+0000","last_undegraded":"2024-09-17T03:13:39.197699+0000","last_fullsized":"2024-09-17T03:13:39.197699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:15.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195911+0000","last_change":"2024-09-17T03:13:34.131912+0000","last_active":"2024-09-17T03:13:39.195911+0000","last_peered":"2024-09-17T03:13:39.195911+0000","last_clean":"2024-09-17T03:13:39.195911+0000","last_became_active":"2024-09-17T03:13:34.130908+0000","last_became_peered":"2024-09-17T03:13:34.130908+0000","last_unstale":"2024-09-17T03:13:39.195911+0000","last_undegraded":"2024-09-17T03:13:39.195911+0000","last_fullsized":"2024-09-17T03:13:39.195911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:09.565865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196018+0000","last_change":"2024-09-17T03:13:38.170051+0000","last_active":"2024-09-17T03:13:39.196018+0000","last_peered":"2024-09-17T03:13:39.196018+0000","last_clean":"2024-09-17T03:13:39.196018+0000","last_became_active":"2024-09-17T03:13:38.169083+0000","last_became_peered":"2024-09-17T03:13:38.169083+0000","last_unstale":"2024-09-17T03:13:39.196018+0000","last_undegraded":"2024-09-17T03:13:39.196018+0000","last_fullsized":"2024-09-17T03:13:39.196018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:53.571359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197904+0000","last_change":"2024-09-17T03:13:33.132790+0000","last_active":"2024-09-17T03:13:39.197904+0000","last_peered":"2024-09-17T03:13:39.197904+0000","last_clean":"2024-09-17T03:13:39.197904+0000","last_became_active":"2024-09-17T03:13:33.132482+0000","last_became_peered":"2024-09-17T03:13:33.132482+0000","last_unstale":"2024-09-17T03:13:39.197904+0000","last_undegraded":"2024-09-17T03:13:39.197904+0000","last_fullsized":"2024-09-17T03:13:39.197904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:36.557061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199238+0000","last_change":"2024-09-17T03:13:34.152246+0000","last_active":"2024-09-17T03:13:39.199238+0000","last_peered":"2024-09-17T03:13:39.199238+0000","last_clean":"2024-09-17T03:13:39.199238+0000","last_became_active":"2024-09-17T03:13:34.151761+0000","last_became_peered":"2024-09-17T03:13:34.151761+0000","last_unstale":"2024-09-17T03:13:39.199238+0000","last_undegraded":"2024-09-17T03:13:39.199238+0000","last_fullsized":"2024-09-17T03:13:39.199238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:55.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195385+0000","last_change":"2024-09-17T03:13:38.182362+0000","last_active":"2024-09-17T03:13:39.195385+0000","last_peered":"2024-09-17T03:13:39.195385+0000","last_clean":"2024-09-17T03:13:39.195385+0000","last_became_active":"2024-09-17T03:13:38.181949+0000","last_became_peered":"2024-09-17T03:13:38.181949+0000","last_unstale":"2024-09-17T03:13:39.195385+0000","last_undegraded":"2024-09-17T03:13:39.195385+0000","last_fullsized":"2024-09-17T03:13:39.195385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:21.583400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198556+0000","last_change":"2024-09-17T03:13:34.130957+0000","last_active":"2024-09-17T03:13:39.198556+0000","last_peered":"2024-09-17T03:13:39.198556+0000","last_clean":"2024-09-17T03:13:39.198556+0000","last_became_active":"2024-09-17T03:13:34.130643+0000","last_became_peered":"2024-09-17T03:13:34.130643+0000","last_unstale":"2024-09-17T03:13:39.198556+0000","last_undegraded":"2024-09-17T03:13:39.198556+0000","last_fullsized":"2024-09-17T03:13:39.198556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:30.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198915+0000","last_change":"2024-09-17T03:13:33.121803+0000","last_active":"2024-09-17T03:13:39.198915+0000","last_peered":"2024-09-17T03:13:39.198915+0000","last_clean":"2024-09-17T03:13:39.198915+0000","last_became_active":"2024-09-17T03:13:33.121396+0000","last_became_peered":"2024-09-17T03:13:33.121396+0000","last_unstale":"2024-09-17T03:13:39.198915+0000","last_undegraded":"2024-09-17T03:13:39.198915+0000","last_fullsized":"2024-09-17T03:13:39.198915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199170+0000","last_change":"2024-09-17T03:13:38.182273+0000","last_active":"2024-09-17T03:13:39.199170+0000","last_peered":"2024-09-17T03:13:39.199170+0000","last_clean":"2024-09-17T03:13:39.199170+0000","last_became_active":"2024-09-17T03:13:38.177607+0000","last_became_peered":"2024-09-17T03:13:38.177607+0000","last_unstale":"2024-09-17T03:13:39.199170+0000","last_undegraded":"2024-09-17T03:13:39.199170+0000","last_fullsized":"2024-09-17T03:13:39.199170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:00.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194949+0000","last_change":"2024-09-17T03:13:34.143115+0000","last_active":"2024-09-17T03:13:39.194949+0000","last_peered":"2024-09-17T03:13:39.194949+0000","last_clean":"2024-09-17T03:13:39.194949+0000","last_became_active":"2024-09-17T03:13:34.142792+0000","last_became_peered":"2024-09-17T03:13:34.142792+0000","last_unstale":"2024-09-17T03:13:39.194949+0000","last_undegraded":"2024-09-17T03:13:39.194949+0000","last_fullsized":"2024-09-17T03:13:39.194949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:16.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158223+0000","last_change":"2024-09-17T03:13:33.119000+0000","last_active":"2024-09-17T03:13:39.158223+0000","last_peered":"2024-09-17T03:13:39.158223+0000","last_clean":"2024-09-17T03:13:39.158223+0000","last_became_active":"2024-09-17T03:13:33.118137+0000","last_became_peered":"2024-09-17T03:13:33.118137+0000","last_unstale":"2024-09-17T03:13:39.158223+0000","last_undegraded":"2024-09-17T03:13:39.158223+0000","last_fullsized":"2024-09-17T03:13:39.158223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:48.663689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197652+0000","last_change":"2024-09-17T03:13:38.169936+0000","last_active":"2024-09-17T03:13:39.197652+0000","last_peered":"2024-09-17T03:13:39.197652+0000","last_clean":"2024-09-17T03:13:39.197652+0000","last_became_active":"2024-09-17T03:13:38.169497+0000","last_became_peered":"2024-09-17T03:13:38.169497+0000","last_unstale":"2024-09-17T03:13:39.197652+0000","last_undegraded":"2024-09-17T03:13:39.197652+0000","last_fullsized":"2024-09-17T03:13:39.197652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:41.815068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160080+0000","last_change":"2024-09-17T03:13:34.140522+0000","last_active":"2024-09-17T03:13:39.160080+0000","last_peered":"2024-09-17T03:13:39.160080+0000","last_clean":"2024-09-17T03:13:39.160080+0000","last_became_active":"2024-09-17T03:13:34.140149+0000","last_became_peered":"2024-09-17T03:13:34.140149+0000","last_unstale":"2024-09-17T03:13:39.160080+0000","last_undegraded":"2024-09-17T03:13:39.160080+0000","last_fullsized":"2024-09-17T03:13:39.160080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:16.959470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161158+0000","last_change":"2024-09-17T03:13:33.137244+0000","last_active":"2024-09-17T03:13:39.161158+0000","last_peered":"2024-09-17T03:13:39.161158+0000","last_clean":"2024-09-17T03:13:39.161158+0000","last_became_active":"2024-09-17T03:13:33.136903+0000","last_became_peered":"2024-09-17T03:13:33.136903+0000","last_unstale":"2024-09-17T03:13:39.161158+0000","last_undegraded":"2024-09-17T03:13:39.161158+0000","last_fullsized":"2024-09-17T03:13:39.161158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195505+0000","last_change":"2024-09-17T03:13:38.177994+0000","last_active":"2024-09-17T03:13:39.195505+0000","last_peered":"2024-09-17T03:13:39.195505+0000","last_clean":"2024-09-17T03:13:39.195505+0000","last_became_active":"2024-09-17T03:13:38.177478+0000","last_became_peered":"2024-09-17T03:13:38.177478+0000","last_unstale":"2024-09-17T03:13:39.195505+0000","last_undegraded":"2024-09-17T03:13:39.195505+0000","last_fullsized":"2024-09-17T03:13:39.195505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:12.414341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198055+0000","last_change":"2024-09-17T03:13:34.130179+0000","last_active":"2024-09-17T03:13:39.198055+0000","last_peered":"2024-09-17T03:13:39.198055+0000","last_clean":"2024-09-17T03:13:39.198055+0000","last_became_active":"2024-09-17T03:13:34.129884+0000","last_became_peered":"2024-09-17T03:13:34.129884+0000","last_unstale":"2024-09-17T03:13:39.198055+0000","last_undegraded":"2024-09-17T03:13:39.198055+0000","last_fullsized":"2024-09-17T03:13:39.198055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:50.196855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194458+0000","last_change":"2024-09-17T03:13:33.122054+0000","last_active":"2024-09-17T03:13:39.194458+0000","last_peered":"2024-09-17T03:13:39.194458+0000","last_clean":"2024-09-17T03:13:39.194458+0000","last_became_active":"2024-09-17T03:13:33.121698+0000","last_became_peered":"2024-09-17T03:13:33.121698+0000","last_unstale":"2024-09-17T03:13:39.194458+0000","last_undegraded":"2024-09-17T03:13:39.194458+0000","last_fullsized":"2024-09-17T03:13:39.194458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:57.578178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198044+0000","last_change":"2024-09-17T03:13:38.171631+0000","last_active":"2024-09-17T03:13:39.198044+0000","last_peered":"2024-09-17T03:13:39.198044+0000","last_clean":"2024-09-17T03:13:39.198044+0000","last_became_active":"2024-09-17T03:13:38.171240+0000","last_became_peered":"2024-09-17T03:13:38.171240+0000","last_unstale":"2024-09-17T03:13:39.198044+0000","last_undegraded":"2024-09-17T03:13:39.198044+0000","last_fullsized":"2024-09-17T03:13:39.198044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.719989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161020+0000","last_change":"2024-09-17T03:13:34.140177+0000","last_active":"2024-09-17T03:13:39.161020+0000","last_peered":"2024-09-17T03:13:39.161020+0000","last_clean":"2024-09-17T03:13:39.161020+0000","last_became_active":"2024-09-17T03:13:34.139841+0000","last_became_peered":"2024-09-17T03:13:34.139841+0000","last_unstale":"2024-09-17T03:13:39.161020+0000","last_undegraded":"2024-09-17T03:13:39.161020+0000","last_fullsized":"2024-09-17T03:13:39.161020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199584+0000","last_change":"2024-09-17T03:13:33.130507+0000","last_active":"2024-09-17T03:13:39.199584+0000","last_peered":"2024-09-17T03:13:39.199584+0000","last_clean":"2024-09-17T03:13:39.199584+0000","last_became_active":"2024-09-17T03:13:33.130209+0000","last_became_peered":"2024-09-17T03:13:33.130209+0000","last_unstale":"2024-09-17T03:13:39.199584+0000","last_undegraded":"2024-09-17T03:13:39.199584+0000","last_fullsized":"2024-09-17T03:13:39.199584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:15.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195482+0000","last_change":"2024-09-17T03:13:38.168304+0000","last_active":"2024-09-17T03:13:39.195482+0000","last_peered":"2024-09-17T03:13:39.195482+0000","last_clean":"2024-09-17T03:13:39.195482+0000","last_became_active":"2024-09-17T03:13:38.168009+0000","last_became_peered":"2024-09-17T03:13:38.168009+0000","last_unstale":"2024-09-17T03:13:39.195482+0000","last_undegraded":"2024-09-17T03:13:39.195482+0000","last_fullsized":"2024-09-17T03:13:39.195482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:37.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160808+0000","last_change":"2024-09-17T03:13:34.126671+0000","last_active":"2024-09-17T03:13:39.160808+0000","last_peered":"2024-09-17T03:13:39.160808+0000","last_clean":"2024-09-17T03:13:39.160808+0000","last_became_active":"2024-09-17T03:13:34.126376+0000","last_became_peered":"2024-09-17T03:13:34.126376+0000","last_unstale":"2024-09-17T03:13:39.160808+0000","last_undegraded":"2024-09-17T03:13:39.160808+0000","last_fullsized":"2024-09-17T03:13:39.160808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161109+0000","last_change":"2024-09-17T03:13:33.137148+0000","last_active":"2024-09-17T03:13:39.161109+0000","last_peered":"2024-09-17T03:13:39.161109+0000","last_clean":"2024-09-17T03:13:39.161109+0000","last_became_active":"2024-09-17T03:13:33.136897+0000","last_became_peered":"2024-09-17T03:13:33.136897+0000","last_unstale":"2024-09-17T03:13:39.161109+0000","last_undegraded":"2024-09-17T03:13:39.161109+0000","last_fullsized":"2024-09-17T03:13:39.161109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160118+0000","last_change":"2024-09-17T03:13:38.176096+0000","last_active":"2024-09-17T03:13:39.160118+0000","last_peered":"2024-09-17T03:13:39.160118+0000","last_clean":"2024-09-17T03:13:39.160118+0000","last_became_active":"2024-09-17T03:13:38.170721+0000","last_became_peered":"2024-09-17T03:13:38.170721+0000","last_unstale":"2024-09-17T03:13:39.160118+0000","last_undegraded":"2024-09-17T03:13:39.160118+0000","last_fullsized":"2024-09-17T03:13:39.160118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.067944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159455+0000","last_change":"2024-09-17T03:13:34.128263+0000","last_active":"2024-09-17T03:13:39.159455+0000","last_peered":"2024-09-17T03:13:39.159455+0000","last_clean":"2024-09-17T03:13:39.159455+0000","last_became_active":"2024-09-17T03:13:34.127855+0000","last_became_peered":"2024-09-17T03:13:34.127855+0000","last_unstale":"2024-09-17T03:13:39.159455+0000","last_undegraded":"2024-09-17T03:13:39.159455+0000","last_fullsized":"2024-09-17T03:13:39.159455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:48.610659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199587+0000","last_change":"2024-09-17T03:13:33.119090+0000","last_active":"2024-09-17T03:13:39.199587+0000","last_peered":"2024-09-17T03:13:39.199587+0000","last_clean":"2024-09-17T03:13:39.199587+0000","last_became_active":"2024-09-17T03:13:33.118370+0000","last_became_peered":"2024-09-17T03:13:33.118370+0000","last_unstale":"2024-09-17T03:13:39.199587+0000","last_undegraded":"2024-09-17T03:13:39.199587+0000","last_fullsized":"2024-09-17T03:13:39.199587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:40.438813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158397+0000","last_change":"2024-09-17T03:13:38.170311+0000","last_active":"2024-09-17T03:13:39.158397+0000","last_peered":"2024-09-17T03:13:39.158397+0000","last_clean":"2024-09-17T03:13:39.158397+0000","last_became_active":"2024-09-17T03:13:38.169794+0000","last_became_peered":"2024-09-17T03:13:38.169794+0000","last_unstale":"2024-09-17T03:13:39.158397+0000","last_undegraded":"2024-09-17T03:13:39.158397+0000","last_fullsized":"2024-09-17T03:13:39.158397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:47.182972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196860+0000","last_change":"2024-09-17T03:13:34.123331+0000","last_active":"2024-09-17T03:13:39.196860+0000","last_peered":"2024-09-17T03:13:39.196860+0000","last_clean":"2024-09-17T03:13:39.196860+0000","last_became_active":"2024-09-17T03:13:34.120225+0000","last_became_peered":"2024-09-17T03:13:34.120225+0000","last_unstale":"2024-09-17T03:13:39.196860+0000","last_undegraded":"2024-09-17T03:13:39.196860+0000","last_fullsized":"2024-09-17T03:13:39.196860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:15.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158326+0000","last_change":"2024-09-17T03:13:33.128407+0000","last_active":"2024-09-17T03:13:39.158326+0000","last_peered":"2024-09-17T03:13:39.158326+0000","last_clean":"2024-09-17T03:13:39.158326+0000","last_became_active":"2024-09-17T03:13:33.128078+0000","last_became_peered":"2024-09-17T03:13:33.128078+0000","last_unstale":"2024-09-17T03:13:39.158326+0000","last_undegraded":"2024-09-17T03:13:39.158326+0000","last_fullsized":"2024-09-17T03:13:39.158326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157547+0000","last_change":"2024-09-17T03:13:38.170011+0000","last_active":"2024-09-17T03:13:39.157547+0000","last_peered":"2024-09-17T03:13:39.157547+0000","last_clean":"2024-09-17T03:13:39.157547+0000","last_became_active":"2024-09-17T03:13:38.169510+0000","last_became_peered":"2024-09-17T03:13:38.169510+0000","last_unstale":"2024-09-17T03:13:39.157547+0000","last_undegraded":"2024-09-17T03:13:39.157547+0000","last_fullsized":"2024-09-17T03:13:39.157547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:32.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196289+0000","last_change":"2024-09-17T03:13:34.150966+0000","last_active":"2024-09-17T03:13:39.196289+0000","last_peered":"2024-09-17T03:13:39.196289+0000","last_clean":"2024-09-17T03:13:39.196289+0000","last_became_active":"2024-09-17T03:13:34.150654+0000","last_became_peered":"2024-09-17T03:13:34.150654+0000","last_unstale":"2024-09-17T03:13:39.196289+0000","last_undegraded":"2024-09-17T03:13:39.196289+0000","last_fullsized":"2024-09-17T03:13:39.196289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:41.752422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198782+0000","last_change":"2024-09-17T03:13:33.125357+0000","last_active":"2024-09-17T03:13:39.198782+0000","last_peered":"2024-09-17T03:13:39.198782+0000","last_clean":"2024-09-17T03:13:39.198782+0000","last_became_active":"2024-09-17T03:13:33.124855+0000","last_became_peered":"2024-09-17T03:13:33.124855+0000","last_unstale":"2024-09-17T03:13:39.198782+0000","last_undegraded":"2024-09-17T03:13:39.198782+0000","last_fullsized":"2024-09-17T03:13:39.198782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.725350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159207+0000","last_change":"2024-09-17T03:13:38.174646+0000","last_active":"2024-09-17T03:13:39.159207+0000","last_peered":"2024-09-17T03:13:39.159207+0000","last_clean":"2024-09-17T03:13:39.159207+0000","last_became_active":"2024-09-17T03:13:38.172014+0000","last_became_peered":"2024-09-17T03:13:38.172014+0000","last_unstale":"2024-09-17T03:13:39.159207+0000","last_undegraded":"2024-09-17T03:13:39.159207+0000","last_fullsized":"2024-09-17T03:13:39.159207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:00.671761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157242+0000","last_change":"2024-09-17T03:13:34.139654+0000","last_active":"2024-09-17T03:13:39.157242+0000","last_peered":"2024-09-17T03:13:39.157242+0000","last_clean":"2024-09-17T03:13:39.157242+0000","last_became_active":"2024-09-17T03:13:34.139302+0000","last_became_peered":"2024-09-17T03:13:34.139302+0000","last_unstale":"2024-09-17T03:13:39.157242+0000","last_undegraded":"2024-09-17T03:13:39.157242+0000","last_fullsized":"2024-09-17T03:13:39.157242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:17.544789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194921+0000","last_change":"2024-09-17T03:13:33.125260+0000","last_active":"2024-09-17T03:13:39.194921+0000","last_peered":"2024-09-17T03:13:39.194921+0000","last_clean":"2024-09-17T03:13:39.194921+0000","last_became_active":"2024-09-17T03:13:33.124837+0000","last_became_peered":"2024-09-17T03:13:33.124837+0000","last_unstale":"2024-09-17T03:13:39.194921+0000","last_undegraded":"2024-09-17T03:13:39.194921+0000","last_fullsized":"2024-09-17T03:13:39.194921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:23.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159089+0000","last_change":"2024-09-17T03:13:38.182098+0000","last_active":"2024-09-17T03:13:39.159089+0000","last_peered":"2024-09-17T03:13:39.159089+0000","last_clean":"2024-09-17T03:13:39.159089+0000","last_became_active":"2024-09-17T03:13:38.181677+0000","last_became_peered":"2024-09-17T03:13:38.181677+0000","last_unstale":"2024-09-17T03:13:39.159089+0000","last_undegraded":"2024-09-17T03:13:39.159089+0000","last_fullsized":"2024-09-17T03:13:39.159089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.122052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157898+0000","last_change":"2024-09-17T03:13:34.137074+0000","last_active":"2024-09-17T03:13:39.157898+0000","last_peered":"2024-09-17T03:13:39.157898+0000","last_clean":"2024-09-17T03:13:39.157898+0000","last_became_active":"2024-09-17T03:13:34.133966+0000","last_became_peered":"2024-09-17T03:13:34.133966+0000","last_unstale":"2024-09-17T03:13:39.157898+0000","last_undegraded":"2024-09-17T03:13:39.157898+0000","last_fullsized":"2024-09-17T03:13:39.157898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196689+0000","last_change":"2024-09-17T03:13:33.126182+0000","last_active":"2024-09-17T03:13:39.196689+0000","last_peered":"2024-09-17T03:13:39.196689+0000","last_clean":"2024-09-17T03:13:39.196689+0000","last_became_active":"2024-09-17T03:13:33.121972+0000","last_became_peered":"2024-09-17T03:13:33.121972+0000","last_unstale":"2024-09-17T03:13:39.196689+0000","last_undegraded":"2024-09-17T03:13:39.196689+0000","last_fullsized":"2024-09-17T03:13:39.196689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:42.270063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159179+0000","last_change":"2024-09-17T03:13:38.168583+0000","last_active":"2024-09-17T03:13:39.159179+0000","last_peered":"2024-09-17T03:13:39.159179+0000","last_clean":"2024-09-17T03:13:39.159179+0000","last_became_active":"2024-09-17T03:13:38.168090+0000","last_became_peered":"2024-09-17T03:13:38.168090+0000","last_unstale":"2024-09-17T03:13:39.159179+0000","last_undegraded":"2024-09-17T03:13:39.159179+0000","last_fullsized":"2024-09-17T03:13:39.159179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:54.235466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160787+0000","last_change":"2024-09-17T03:13:34.112239+0000","last_active":"2024-09-17T03:13:39.160787+0000","last_peered":"2024-09-17T03:13:39.160787+0000","last_clean":"2024-09-17T03:13:39.160787+0000","last_became_active":"2024-09-17T03:13:34.111911+0000","last_became_peered":"2024-09-17T03:13:34.111911+0000","last_unstale":"2024-09-17T03:13:39.160787+0000","last_undegraded":"2024-09-17T03:13:39.160787+0000","last_fullsized":"2024-09-17T03:13:39.160787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:08.503088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198916+0000","last_change":"2024-09-17T03:13:33.125715+0000","last_active":"2024-09-17T03:13:39.198916+0000","last_peered":"2024-09-17T03:13:39.198916+0000","last_clean":"2024-09-17T03:13:39.198916+0000","last_became_active":"2024-09-17T03:13:33.125194+0000","last_became_peered":"2024-09-17T03:13:33.125194+0000","last_unstale":"2024-09-17T03:13:39.198916+0000","last_undegraded":"2024-09-17T03:13:39.198916+0000","last_fullsized":"2024-09-17T03:13:39.198916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:19.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196858+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:13:39.196858+0000","last_peered":"2024-09-17T03:13:39.196858+0000","last_clean":"2024-09-17T03:13:39.196858+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:13:39.196858+0000","last_undegraded":"2024-09-17T03:13:39.196858+0000","last_fullsized":"2024-09-17T03:13:39.196858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199547+0000","last_change":"2024-09-17T03:13:38.167682+0000","last_active":"2024-09-17T03:13:39.199547+0000","last_peered":"2024-09-17T03:13:39.199547+0000","last_clean":"2024-09-17T03:13:39.199547+0000","last_became_active":"2024-09-17T03:13:38.167110+0000","last_became_peered":"2024-09-17T03:13:38.167110+0000","last_unstale":"2024-09-17T03:13:39.199547+0000","last_undegraded":"2024-09-17T03:13:39.199547+0000","last_fullsized":"2024-09-17T03:13:39.199547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:12.466588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199361+0000","last_change":"2024-09-17T03:13:34.131142+0000","last_active":"2024-09-17T03:13:39.199361+0000","last_peered":"2024-09-17T03:13:39.199361+0000","last_clean":"2024-09-17T03:13:39.199361+0000","last_became_active":"2024-09-17T03:13:34.130839+0000","last_became_peered":"2024-09-17T03:13:34.130839+0000","last_unstale":"2024-09-17T03:13:39.199361+0000","last_undegraded":"2024-09-17T03:13:39.199361+0000","last_fullsized":"2024-09-17T03:13:39.199361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:37.776457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159474+0000","last_change":"2024-09-17T03:13:33.133189+0000","last_active":"2024-09-17T03:13:39.159474+0000","last_peered":"2024-09-17T03:13:39.159474+0000","last_clean":"2024-09-17T03:13:39.159474+0000","last_became_active":"2024-09-17T03:13:33.132836+0000","last_became_peered":"2024-09-17T03:13:33.132836+0000","last_unstale":"2024-09-17T03:13:39.159474+0000","last_undegraded":"2024-09-17T03:13:39.159474+0000","last_fullsized":"2024-09-17T03:13:39.159474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:51.274515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196215+0000","last_change":"2024-09-17T03:13:38.183375+0000","last_active":"2024-09-17T03:13:39.196215+0000","last_peered":"2024-09-17T03:13:39.196215+0000","last_clean":"2024-09-17T03:13:39.196215+0000","last_became_active":"2024-09-17T03:13:38.182947+0000","last_became_peered":"2024-09-17T03:13:38.182947+0000","last_unstale":"2024-09-17T03:13:39.196215+0000","last_undegraded":"2024-09-17T03:13:39.196215+0000","last_fullsized":"2024-09-17T03:13:39.196215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.792778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197849+0000","last_change":"2024-09-17T03:13:34.142680+0000","last_active":"2024-09-17T03:13:39.197849+0000","last_peered":"2024-09-17T03:13:39.197849+0000","last_clean":"2024-09-17T03:13:39.197849+0000","last_became_active":"2024-09-17T03:13:34.142375+0000","last_became_peered":"2024-09-17T03:13:34.142375+0000","last_unstale":"2024-09-17T03:13:39.197849+0000","last_undegraded":"2024-09-17T03:13:39.197849+0000","last_fullsized":"2024-09-17T03:13:39.197849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160135+0000","last_change":"2024-09-17T03:13:33.121940+0000","last_active":"2024-09-17T03:13:39.160135+0000","last_peered":"2024-09-17T03:13:39.160135+0000","last_clean":"2024-09-17T03:13:39.160135+0000","last_became_active":"2024-09-17T03:13:33.121454+0000","last_became_peered":"2024-09-17T03:13:33.121454+0000","last_unstale":"2024-09-17T03:13:39.160135+0000","last_undegraded":"2024-09-17T03:13:39.160135+0000","last_fullsized":"2024-09-17T03:13:39.160135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158537+0000","last_change":"2024-09-17T03:13:38.175006+0000","last_active":"2024-09-17T03:13:39.158537+0000","last_peered":"2024-09-17T03:13:39.158537+0000","last_clean":"2024-09-17T03:13:39.158537+0000","last_became_active":"2024-09-17T03:13:38.174354+0000","last_became_peered":"2024-09-17T03:13:38.174354+0000","last_unstale":"2024-09-17T03:13:39.158537+0000","last_undegraded":"2024-09-17T03:13:39.158537+0000","last_fullsized":"2024-09-17T03:13:39.158537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:46.350871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198197+0000","last_change":"2024-09-17T03:13:34.134217+0000","last_active":"2024-09-17T03:13:39.198197+0000","last_peered":"2024-09-17T03:13:39.198197+0000","last_clean":"2024-09-17T03:13:39.198197+0000","last_became_active":"2024-09-17T03:13:34.133864+0000","last_became_peered":"2024-09-17T03:13:34.133864+0000","last_unstale":"2024-09-17T03:13:39.198197+0000","last_undegraded":"2024-09-17T03:13:39.198197+0000","last_fullsized":"2024-09-17T03:13:39.198197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.172692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160941+0000","last_change":"2024-09-17T03:13:33.126989+0000","last_active":"2024-09-17T03:13:39.160941+0000","last_peered":"2024-09-17T03:13:39.160941+0000","last_clean":"2024-09-17T03:13:39.160941+0000","last_became_active":"2024-09-17T03:13:33.126662+0000","last_became_peered":"2024-09-17T03:13:33.126662+0000","last_unstale":"2024-09-17T03:13:39.160941+0000","last_undegraded":"2024-09-17T03:13:39.160941+0000","last_fullsized":"2024-09-17T03:13:39.160941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196440+0000","last_change":"2024-09-17T03:13:38.171271+0000","last_active":"2024-09-17T03:13:39.196440+0000","last_peered":"2024-09-17T03:13:39.196440+0000","last_clean":"2024-09-17T03:13:39.196440+0000","last_became_active":"2024-09-17T03:13:38.170206+0000","last_became_peered":"2024-09-17T03:13:38.170206+0000","last_unstale":"2024-09-17T03:13:39.196440+0000","last_undegraded":"2024-09-17T03:13:39.196440+0000","last_fullsized":"2024-09-17T03:13:39.196440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.198605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197293+0000","last_change":"2024-09-17T03:13:34.140674+0000","last_active":"2024-09-17T03:13:39.197293+0000","last_peered":"2024-09-17T03:13:39.197293+0000","last_clean":"2024-09-17T03:13:39.197293+0000","last_became_active":"2024-09-17T03:13:34.140286+0000","last_became_peered":"2024-09-17T03:13:34.140286+0000","last_unstale":"2024-09-17T03:13:39.197293+0000","last_undegraded":"2024-09-17T03:13:39.197293+0000","last_fullsized":"2024-09-17T03:13:39.197293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:16.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198435+0000","last_change":"2024-09-17T03:13:33.129963+0000","last_active":"2024-09-17T03:13:39.198435+0000","last_peered":"2024-09-17T03:13:39.198435+0000","last_clean":"2024-09-17T03:13:39.198435+0000","last_became_active":"2024-09-17T03:13:33.128743+0000","last_became_peered":"2024-09-17T03:13:33.128743+0000","last_unstale":"2024-09-17T03:13:39.198435+0000","last_undegraded":"2024-09-17T03:13:39.198435+0000","last_fullsized":"2024-09-17T03:13:39.198435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:59.444297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195666+0000","last_change":"2024-09-17T03:13:38.174410+0000","last_active":"2024-09-17T03:13:39.195666+0000","last_peered":"2024-09-17T03:13:39.195666+0000","last_clean":"2024-09-17T03:13:39.195666+0000","last_became_active":"2024-09-17T03:13:38.168524+0000","last_became_peered":"2024-09-17T03:13:38.168524+0000","last_unstale":"2024-09-17T03:13:39.195666+0000","last_undegraded":"2024-09-17T03:13:39.195666+0000","last_fullsized":"2024-09-17T03:13:39.195666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:11.387448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198030+0000","last_change":"2024-09-17T03:13:34.129876+0000","last_active":"2024-09-17T03:13:39.198030+0000","last_peered":"2024-09-17T03:13:39.198030+0000","last_clean":"2024-09-17T03:13:39.198030+0000","last_became_active":"2024-09-17T03:13:34.128110+0000","last_became_peered":"2024-09-17T03:13:34.128110+0000","last_unstale":"2024-09-17T03:13:39.198030+0000","last_undegraded":"2024-09-17T03:13:39.198030+0000","last_fullsized":"2024-09-17T03:13:39.198030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:04.560173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160218+0000","last_change":"2024-09-17T03:13:33.125002+0000","last_active":"2024-09-17T03:13:39.160218+0000","last_peered":"2024-09-17T03:13:39.160218+0000","last_clean":"2024-09-17T03:13:39.160218+0000","last_became_active":"2024-09-17T03:13:33.124643+0000","last_became_peered":"2024-09-17T03:13:33.124643+0000","last_unstale":"2024-09-17T03:13:39.160218+0000","last_undegraded":"2024-09-17T03:13:39.160218+0000","last_fullsized":"2024-09-17T03:13:39.160218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159507+0000","last_change":"2024-09-17T03:13:38.171833+0000","last_active":"2024-09-17T03:13:39.159507+0000","last_peered":"2024-09-17T03:13:39.159507+0000","last_clean":"2024-09-17T03:13:39.159507+0000","last_became_active":"2024-09-17T03:13:38.171380+0000","last_became_peered":"2024-09-17T03:13:38.171380+0000","last_unstale":"2024-09-17T03:13:39.159507+0000","last_undegraded":"2024-09-17T03:13:39.159507+0000","last_fullsized":"2024-09-17T03:13:39.159507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:43.248158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196746+0000","last_change":"2024-09-17T03:13:34.127390+0000","last_active":"2024-09-17T03:13:39.196746+0000","last_peered":"2024-09-17T03:13:39.196746+0000","last_clean":"2024-09-17T03:13:39.196746+0000","last_became_active":"2024-09-17T03:13:34.126867+0000","last_became_peered":"2024-09-17T03:13:34.126867+0000","last_unstale":"2024-09-17T03:13:39.196746+0000","last_undegraded":"2024-09-17T03:13:39.196746+0000","last_fullsized":"2024-09-17T03:13:39.196746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:45.924771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195084+0000","last_change":"2024-09-17T03:13:33.134673+0000","last_active":"2024-09-17T03:13:39.195084+0000","last_peered":"2024-09-17T03:13:39.195084+0000","last_clean":"2024-09-17T03:13:39.195084+0000","last_became_active":"2024-09-17T03:13:33.134335+0000","last_became_peered":"2024-09-17T03:13:33.134335+0000","last_unstale":"2024-09-17T03:13:39.195084+0000","last_undegraded":"2024-09-17T03:13:39.195084+0000","last_fullsized":"2024-09-17T03:13:39.195084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:19.536470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159940+0000","last_change":"2024-09-17T03:13:38.170527+0000","last_active":"2024-09-17T03:13:39.159940+0000","last_peered":"2024-09-17T03:13:39.159940+0000","last_clean":"2024-09-17T03:13:39.159940+0000","last_became_active":"2024-09-17T03:13:38.170114+0000","last_became_peered":"2024-09-17T03:13:38.170114+0000","last_unstale":"2024-09-17T03:13:39.159940+0000","last_undegraded":"2024-09-17T03:13:39.159940+0000","last_fullsized":"2024-09-17T03:13:39.159940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.118342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197562+0000","last_change":"2024-09-17T03:13:34.145344+0000","last_active":"2024-09-17T03:13:39.197562+0000","last_peered":"2024-09-17T03:13:39.197562+0000","last_clean":"2024-09-17T03:13:39.197562+0000","last_became_active":"2024-09-17T03:13:34.145041+0000","last_became_peered":"2024-09-17T03:13:34.145041+0000","last_unstale":"2024-09-17T03:13:39.197562+0000","last_undegraded":"2024-09-17T03:13:39.197562+0000","last_fullsized":"2024-09-17T03:13:39.197562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:42.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198728+0000","last_change":"2024-09-17T03:13:33.125668+0000","last_active":"2024-09-17T03:13:39.198728+0000","last_peered":"2024-09-17T03:13:39.198728+0000","last_clean":"2024-09-17T03:13:39.198728+0000","last_became_active":"2024-09-17T03:13:33.125357+0000","last_became_peered":"2024-09-17T03:13:33.125357+0000","last_unstale":"2024-09-17T03:13:39.198728+0000","last_undegraded":"2024-09-17T03:13:39.198728+0000","last_fullsized":"2024-09-17T03:13:39.198728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.692949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159384+0000","last_change":"2024-09-17T03:13:38.174239+0000","last_active":"2024-09-17T03:13:39.159384+0000","last_peered":"2024-09-17T03:13:39.159384+0000","last_clean":"2024-09-17T03:13:39.159384+0000","last_became_active":"2024-09-17T03:13:38.171412+0000","last_became_peered":"2024-09-17T03:13:38.171412+0000","last_unstale":"2024-09-17T03:13:39.159384+0000","last_undegraded":"2024-09-17T03:13:39.159384+0000","last_fullsized":"2024-09-17T03:13:39.159384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:06.888462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157843+0000","last_change":"2024-09-17T03:13:34.125801+0000","last_active":"2024-09-17T03:13:39.157843+0000","last_peered":"2024-09-17T03:13:39.157843+0000","last_clean":"2024-09-17T03:13:39.157843+0000","last_became_active":"2024-09-17T03:13:34.125205+0000","last_became_peered":"2024-09-17T03:13:34.125205+0000","last_unstale":"2024-09-17T03:13:39.157843+0000","last_undegraded":"2024-09-17T03:13:39.157843+0000","last_fullsized":"2024-09-17T03:13:39.157843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195177+0000","last_change":"2024-09-17T03:13:33.139264+0000","last_active":"2024-09-17T03:13:39.195177+0000","last_peered":"2024-09-17T03:13:39.195177+0000","last_clean":"2024-09-17T03:13:39.195177+0000","last_became_active":"2024-09-17T03:13:33.138945+0000","last_became_peered":"2024-09-17T03:13:33.138945+0000","last_unstale":"2024-09-17T03:13:39.195177+0000","last_undegraded":"2024-09-17T03:13:39.195177+0000","last_fullsized":"2024-09-17T03:13:39.195177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:06.266580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199260+0000","last_change":"2024-09-17T03:13:38.179790+0000","last_active":"2024-09-17T03:13:39.199260+0000","last_peered":"2024-09-17T03:13:39.199260+0000","last_clean":"2024-09-17T03:13:39.199260+0000","last_became_active":"2024-09-17T03:13:38.176965+0000","last_became_peered":"2024-09-17T03:13:38.176965+0000","last_unstale":"2024-09-17T03:13:39.199260+0000","last_undegraded":"2024-09-17T03:13:39.199260+0000","last_fullsized":"2024-09-17T03:13:39.199260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.524936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197505+0000","last_change":"2024-09-17T03:13:34.150718+0000","last_active":"2024-09-17T03:13:39.197505+0000","last_peered":"2024-09-17T03:13:39.197505+0000","last_clean":"2024-09-17T03:13:39.197505+0000","last_became_active":"2024-09-17T03:13:34.150380+0000","last_became_peered":"2024-09-17T03:13:34.150380+0000","last_unstale":"2024-09-17T03:13:39.197505+0000","last_undegraded":"2024-09-17T03:13:39.197505+0000","last_fullsized":"2024-09-17T03:13:39.197505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:45.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'7","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195959+0000","last_change":"2024-09-17T03:13:33.115018+0000","last_active":"2024-09-17T03:13:39.195959+0000","last_peered":"2024-09-17T03:13:39.195959+0000","last_clean":"2024-09-17T03:13:39.195959+0000","last_became_active":"2024-09-17T03:13:33.114688+0000","last_became_peered":"2024-09-17T03:13:33.114688+0000","last_unstale":"2024-09-17T03:13:39.195959+0000","last_undegraded":"2024-09-17T03:13:39.195959+0000","last_fullsized":"2024-09-17T03:13:39.195959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.942641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2061,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160669+0000","last_change":"2024-09-17T03:13:38.175179+0000","last_active":"2024-09-17T03:13:39.160669+0000","last_peered":"2024-09-17T03:13:39.160669+0000","last_clean":"2024-09-17T03:13:39.160669+0000","last_became_active":"2024-09-17T03:13:38.172867+0000","last_became_peered":"2024-09-17T03:13:38.172867+0000","last_unstale":"2024-09-17T03:13:39.160669+0000","last_undegraded":"2024-09-17T03:13:39.160669+0000","last_fullsized":"2024-09-17T03:13:39.160669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:37.361119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199202+0000","last_change":"2024-09-17T03:13:34.124140+0000","last_active":"2024-09-17T03:13:39.199202+0000","last_peered":"2024-09-17T03:13:39.199202+0000","last_clean":"2024-09-17T03:13:39.199202+0000","last_became_active":"2024-09-17T03:13:34.123830+0000","last_became_peered":"2024-09-17T03:13:34.123830+0000","last_unstale":"2024-09-17T03:13:39.199202+0000","last_undegraded":"2024-09-17T03:13:39.199202+0000","last_fullsized":"2024-09-17T03:13:39.199202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:33.119048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195209+0000","last_change":"2024-09-17T03:13:33.132508+0000","last_active":"2024-09-17T03:13:39.195209+0000","last_peered":"2024-09-17T03:13:39.195209+0000","last_clean":"2024-09-17T03:13:39.195209+0000","last_became_active":"2024-09-17T03:13:33.132171+0000","last_became_peered":"2024-09-17T03:13:33.132171+0000","last_unstale":"2024-09-17T03:13:39.195209+0000","last_undegraded":"2024-09-17T03:13:39.195209+0000","last_fullsized":"2024-09-17T03:13:39.195209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:24.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196268+0000","last_change":"2024-09-17T03:13:38.170462+0000","last_active":"2024-09-17T03:13:39.196268+0000","last_peered":"2024-09-17T03:13:39.196268+0000","last_clean":"2024-09-17T03:13:39.196268+0000","last_became_active":"2024-09-17T03:13:38.169604+0000","last_became_peered":"2024-09-17T03:13:38.169604+0000","last_unstale":"2024-09-17T03:13:39.196268+0000","last_undegraded":"2024-09-17T03:13:39.196268+0000","last_fullsized":"2024-09-17T03:13:39.196268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:40.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160025+0000","last_change":"2024-09-17T03:13:34.128238+0000","last_active":"2024-09-17T03:13:39.160025+0000","last_peered":"2024-09-17T03:13:39.160025+0000","last_clean":"2024-09-17T03:13:39.160025+0000","last_became_active":"2024-09-17T03:13:34.127900+0000","last_became_peered":"2024-09-17T03:13:34.127900+0000","last_unstale":"2024-09-17T03:13:39.160025+0000","last_undegraded":"2024-09-17T03:13:39.160025+0000","last_fullsized":"2024-09-17T03:13:39.160025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197209+0000","last_change":"2024-09-17T03:13:33.133386+0000","last_active":"2024-09-17T03:13:39.197209+0000","last_peered":"2024-09-17T03:13:39.197209+0000","last_clean":"2024-09-17T03:13:39.197209+0000","last_became_active":"2024-09-17T03:13:33.132496+0000","last_became_peered":"2024-09-17T03:13:33.132496+0000","last_unstale":"2024-09-17T03:13:39.197209+0000","last_undegraded":"2024-09-17T03:13:39.197209+0000","last_fullsized":"2024-09-17T03:13:39.197209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:53.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194730+0000","last_change":"2024-09-17T03:13:38.176141+0000","last_active":"2024-09-17T03:13:39.194730+0000","last_peered":"2024-09-17T03:13:39.194730+0000","last_clean":"2024-09-17T03:13:39.194730+0000","last_became_active":"2024-09-17T03:13:38.175441+0000","last_became_peered":"2024-09-17T03:13:38.175441+0000","last_unstale":"2024-09-17T03:13:39.194730+0000","last_undegraded":"2024-09-17T03:13:39.194730+0000","last_fullsized":"2024-09-17T03:13:39.194730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:24.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197192+0000","last_change":"2024-09-17T03:13:34.127326+0000","last_active":"2024-09-17T03:13:39.197192+0000","last_peered":"2024-09-17T03:13:39.197192+0000","last_clean":"2024-09-17T03:13:39.197192+0000","last_became_active":"2024-09-17T03:13:34.126960+0000","last_became_peered":"2024-09-17T03:13:34.126960+0000","last_unstale":"2024-09-17T03:13:39.197192+0000","last_undegraded":"2024-09-17T03:13:39.197192+0000","last_fullsized":"2024-09-17T03:13:39.197192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:05.699702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197544+0000","last_change":"2024-09-17T03:13:33.127320+0000","last_active":"2024-09-17T03:13:39.197544+0000","last_peered":"2024-09-17T03:13:39.197544+0000","last_clean":"2024-09-17T03:13:39.197544+0000","last_became_active":"2024-09-17T03:13:33.126979+0000","last_became_peered":"2024-09-17T03:13:33.126979+0000","last_unstale":"2024-09-17T03:13:39.197544+0000","last_undegraded":"2024-09-17T03:13:39.197544+0000","last_fullsized":"2024-09-17T03:13:39.197544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160474+0000","last_change":"2024-09-17T03:13:38.170474+0000","last_active":"2024-09-17T03:13:39.160474+0000","last_peered":"2024-09-17T03:13:39.160474+0000","last_clean":"2024-09-17T03:13:39.160474+0000","last_became_active":"2024-09-17T03:13:38.169227+0000","last_became_peered":"2024-09-17T03:13:38.169227+0000","last_unstale":"2024-09-17T03:13:39.160474+0000","last_undegraded":"2024-09-17T03:13:39.160474+0000","last_fullsized":"2024-09-17T03:13:39.160474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:39.513902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160847+0000","last_change":"2024-09-17T03:13:38.173752+0000","last_active":"2024-09-17T03:13:39.160847+0000","last_peered":"2024-09-17T03:13:39.160847+0000","last_clean":"2024-09-17T03:13:39.160847+0000","last_became_active":"2024-09-17T03:13:38.173339+0000","last_became_peered":"2024-09-17T03:13:38.173339+0000","last_unstale":"2024-09-17T03:13:39.160847+0000","last_undegraded":"2024-09-17T03:13:39.160847+0000","last_fullsized":"2024-09-17T03:13:39.160847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:49.042265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161197+0000","last_change":"2024-09-17T03:13:34.128858+0000","last_active":"2024-09-17T03:13:39.161197+0000","last_peered":"2024-09-17T03:13:39.161197+0000","last_clean":"2024-09-17T03:13:39.161197+0000","last_became_active":"2024-09-17T03:13:34.128470+0000","last_became_peered":"2024-09-17T03:13:34.128470+0000","last_unstale":"2024-09-17T03:13:39.161197+0000","last_undegraded":"2024-09-17T03:13:39.161197+0000","last_fullsized":"2024-09-17T03:13:39.161197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:20.842323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196620+0000","last_change":"2024-09-17T03:13:33.123650+0000","last_active":"2024-09-17T03:13:39.196620+0000","last_peered":"2024-09-17T03:13:39.196620+0000","last_clean":"2024-09-17T03:13:39.196620+0000","last_became_active":"2024-09-17T03:13:33.123336+0000","last_became_peered":"2024-09-17T03:13:33.123336+0000","last_unstale":"2024-09-17T03:13:39.196620+0000","last_undegraded":"2024-09-17T03:13:39.196620+0000","last_fullsized":"2024-09-17T03:13:39.196620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:22.478021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199452+0000","last_change":"2024-09-17T03:13:38.186350+0000","last_active":"2024-09-17T03:13:39.199452+0000","last_peered":"2024-09-17T03:13:39.199452+0000","last_clean":"2024-09-17T03:13:39.199452+0000","last_became_active":"2024-09-17T03:13:38.185605+0000","last_became_peered":"2024-09-17T03:13:38.185605+0000","last_unstale":"2024-09-17T03:13:39.199452+0000","last_undegraded":"2024-09-17T03:13:39.199452+0000","last_fullsized":"2024-09-17T03:13:39.199452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:12.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157345+0000","last_change":"2024-09-17T03:13:34.125368+0000","last_active":"2024-09-17T03:13:39.157345+0000","last_peered":"2024-09-17T03:13:39.157345+0000","last_clean":"2024-09-17T03:13:39.157345+0000","last_became_active":"2024-09-17T03:13:34.124883+0000","last_became_peered":"2024-09-17T03:13:34.124883+0000","last_unstale":"2024-09-17T03:13:39.157345+0000","last_undegraded":"2024-09-17T03:13:39.157345+0000","last_fullsized":"2024-09-17T03:13:39.157345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158046+0000","last_change":"2024-09-17T03:13:33.128441+0000","last_active":"2024-09-17T03:13:39.158046+0000","last_peered":"2024-09-17T03:13:39.158046+0000","last_clean":"2024-09-17T03:13:39.158046+0000","last_became_active":"2024-09-17T03:13:33.128152+0000","last_became_peered":"2024-09-17T03:13:33.128152+0000","last_unstale":"2024-09-17T03:13:39.158046+0000","last_undegraded":"2024-09-17T03:13:39.158046+0000","last_fullsized":"2024-09-17T03:13:39.158046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:06.006592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198671+0000","last_change":"2024-09-17T03:13:33.128570+0000","last_active":"2024-09-17T03:13:39.198671+0000","last_peered":"2024-09-17T03:13:39.198671+0000","last_clean":"2024-09-17T03:13:39.198671+0000","last_became_active":"2024-09-17T03:13:33.128178+0000","last_became_peered":"2024-09-17T03:13:33.128178+0000","last_unstale":"2024-09-17T03:13:39.198671+0000","last_undegraded":"2024-09-17T03:13:39.198671+0000","last_fullsized":"2024-09-17T03:13:39.198671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.359407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160314+0000","last_change":"2024-09-17T03:13:34.136349+0000","last_active":"2024-09-17T03:13:39.160314+0000","last_peered":"2024-09-17T03:13:39.160314+0000","last_clean":"2024-09-17T03:13:39.160314+0000","last_became_active":"2024-09-17T03:13:34.135978+0000","last_became_peered":"2024-09-17T03:13:34.135978+0000","last_unstale":"2024-09-17T03:13:39.160314+0000","last_undegraded":"2024-09-17T03:13:39.160314+0000","last_fullsized":"2024-09-17T03:13:39.160314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:08.375730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161237+0000","last_change":"2024-09-17T03:13:38.179343+0000","last_active":"2024-09-17T03:13:39.161237+0000","last_peered":"2024-09-17T03:13:39.161237+0000","last_clean":"2024-09-17T03:13:39.161237+0000","last_became_active":"2024-09-17T03:13:38.178868+0000","last_became_peered":"2024-09-17T03:13:38.178868+0000","last_unstale":"2024-09-17T03:13:39.161237+0000","last_undegraded":"2024-09-17T03:13:39.161237+0000","last_fullsized":"2024-09-17T03:13:39.161237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:58.731297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158741+0000","last_change":"2024-09-17T03:13:33.126321+0000","last_active":"2024-09-17T03:13:39.158741+0000","last_peered":"2024-09-17T03:13:39.158741+0000","last_clean":"2024-09-17T03:13:39.158741+0000","last_became_active":"2024-09-17T03:13:33.124412+0000","last_became_peered":"2024-09-17T03:13:33.124412+0000","last_unstale":"2024-09-17T03:13:39.158741+0000","last_undegraded":"2024-09-17T03:13:39.158741+0000","last_fullsized":"2024-09-17T03:13:39.158741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196954+0000","last_change":"2024-09-17T03:13:34.126417+0000","last_active":"2024-09-17T03:13:39.196954+0000","last_peered":"2024-09-17T03:13:39.196954+0000","last_clean":"2024-09-17T03:13:39.196954+0000","last_became_active":"2024-09-17T03:13:34.126094+0000","last_became_peered":"2024-09-17T03:13:34.126094+0000","last_unstale":"2024-09-17T03:13:39.196954+0000","last_undegraded":"2024-09-17T03:13:39.196954+0000","last_fullsized":"2024-09-17T03:13:39.196954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195295+0000","last_change":"2024-09-17T03:13:38.181805+0000","last_active":"2024-09-17T03:13:39.195295+0000","last_peered":"2024-09-17T03:13:39.195295+0000","last_clean":"2024-09-17T03:13:39.195295+0000","last_became_active":"2024-09-17T03:13:38.181287+0000","last_became_peered":"2024-09-17T03:13:38.181287+0000","last_unstale":"2024-09-17T03:13:39.195295+0000","last_undegraded":"2024-09-17T03:13:39.195295+0000","last_fullsized":"2024-09-17T03:13:39.195295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:17.193253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194766+0000","last_change":"2024-09-17T03:13:34.125233+0000","last_active":"2024-09-17T03:13:39.194766+0000","last_peered":"2024-09-17T03:13:39.194766+0000","last_clean":"2024-09-17T03:13:39.194766+0000","last_became_active":"2024-09-17T03:13:34.115962+0000","last_became_peered":"2024-09-17T03:13:34.115962+0000","last_unstale":"2024-09-17T03:13:39.194766+0000","last_undegraded":"2024-09-17T03:13:39.194766+0000","last_fullsized":"2024-09-17T03:13:39.194766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194622+0000","last_change":"2024-09-17T03:13:34.142202+0000","last_active":"2024-09-17T03:13:39.194622+0000","last_peered":"2024-09-17T03:13:39.194622+0000","last_clean":"2024-09-17T03:13:39.194622+0000","last_became_active":"2024-09-17T03:13:34.141894+0000","last_became_peered":"2024-09-17T03:13:34.141894+0000","last_unstale":"2024-09-17T03:13:39.194622+0000","last_undegraded":"2024-09-17T03:13:39.194622+0000","last_fullsized":"2024-09-17T03:13:39.194622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198442+0000","last_change":"2024-09-17T03:13:34.128354+0000","last_active":"2024-09-17T03:13:39.198442+0000","last_peered":"2024-09-17T03:13:39.198442+0000","last_clean":"2024-09-17T03:13:39.198442+0000","last_became_active":"2024-09-17T03:13:34.128064+0000","last_became_peered":"2024-09-17T03:13:34.128064+0000","last_unstale":"2024-09-17T03:13:39.198442+0000","last_undegraded":"2024-09-17T03:13:39.198442+0000","last_fullsized":"2024-09-17T03:13:39.198442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158623+0000","last_change":"2024-09-17T03:13:34.140919+0000","last_active":"2024-09-17T03:13:39.158623+0000","last_peered":"2024-09-17T03:13:39.158623+0000","last_clean":"2024-09-17T03:13:39.158623+0000","last_became_active":"2024-09-17T03:13:34.140561+0000","last_became_peered":"2024-09-17T03:13:34.140561+0000","last_unstale":"2024-09-17T03:13:39.158623+0000","last_undegraded":"2024-09-17T03:13:39.158623+0000","last_fullsized":"2024-09-17T03:13:39.158623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.397850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159371+0000","last_change":"2024-09-17T03:13:34.137429+0000","last_active":"2024-09-17T03:13:39.159371+0000","last_peered":"2024-09-17T03:13:39.159371+0000","last_clean":"2024-09-17T03:13:39.159371+0000","last_became_active":"2024-09-17T03:13:34.135149+0000","last_became_peered":"2024-09-17T03:13:34.135149+0000","last_unstale":"2024-09-17T03:13:39.159371+0000","last_undegraded":"2024-09-17T03:13:39.159371+0000","last_fullsized":"2024-09-17T03:13:39.159371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158439+0000","last_change":"2024-09-17T03:13:34.144580+0000","last_active":"2024-09-17T03:13:39.158439+0000","last_peered":"2024-09-17T03:13:39.158439+0000","last_clean":"2024-09-17T03:13:39.158439+0000","last_became_active":"2024-09-17T03:13:34.144100+0000","last_became_peered":"2024-09-17T03:13:34.144100+0000","last_unstale":"2024-09-17T03:13:39.158439+0000","last_undegraded":"2024-09-17T03:13:39.158439+0000","last_fullsized":"2024-09-17T03:13:39.158439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.561070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197089+0000","last_change":"2024-09-17T03:13:34.132354+0000","last_active":"2024-09-17T03:13:39.197089+0000","last_peered":"2024-09-17T03:13:39.197089+0000","last_clean":"2024-09-17T03:13:39.197089+0000","last_became_active":"2024-09-17T03:13:34.131250+0000","last_became_peered":"2024-09-17T03:13:34.131250+0000","last_unstale":"2024-09-17T03:13:39.197089+0000","last_undegraded":"2024-09-17T03:13:39.197089+0000","last_fullsized":"2024-09-17T03:13:39.197089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:41.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159577+0000","last_change":"2024-09-17T03:13:34.134701+0000","last_active":"2024-09-17T03:13:39.159577+0000","last_peered":"2024-09-17T03:13:39.159577+0000","last_clean":"2024-09-17T03:13:39.159577+0000","last_became_active":"2024-09-17T03:13:34.134341+0000","last_became_peered":"2024-09-17T03:13:34.134341+0000","last_unstale":"2024-09-17T03:13:39.159577+0000","last_undegraded":"2024-09-17T03:13:39.159577+0000","last_fullsized":"2024-09-17T03:13:39.159577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:36.866564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196579+0000","last_change":"2024-09-17T03:13:34.128615+0000","last_active":"2024-09-17T03:13:39.196579+0000","last_peered":"2024-09-17T03:13:39.196579+0000","last_clean":"2024-09-17T03:13:39.196579+0000","last_became_active":"2024-09-17T03:13:34.128116+0000","last_became_peered":"2024-09-17T03:13:34.128116+0000","last_unstale":"2024-09-17T03:13:39.196579+0000","last_undegraded":"2024-09-17T03:13:39.196579+0000","last_fullsized":"2024-09-17T03:13:39.196579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157351+0000","last_change":"2024-09-17T03:13:34.134305+0000","last_active":"2024-09-17T03:13:39.157351+0000","last_peered":"2024-09-17T03:13:39.157351+0000","last_clean":"2024-09-17T03:13:39.157351+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.157351+0000","last_undegraded":"2024-09-17T03:13:39.157351+0000","last_fullsized":"2024-09-17T03:13:39.157351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196833+0000","last_change":"2024-09-17T03:13:34.138279+0000","last_active":"2024-09-17T03:13:39.196833+0000","last_peered":"2024-09-17T03:13:39.196833+0000","last_clean":"2024-09-17T03:13:39.196833+0000","last_became_active":"2024-09-17T03:13:34.137706+0000","last_became_peered":"2024-09-17T03:13:34.137706+0000","last_unstale":"2024-09-17T03:13:39.196833+0000","last_undegraded":"2024-09-17T03:13:39.196833+0000","last_fullsized":"2024-09-17T03:13:39.196833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:02.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160062+0000","last_change":"2024-09-17T03:13:34.125660+0000","last_active":"2024-09-17T03:13:39.160062+0000","last_peered":"2024-09-17T03:13:39.160062+0000","last_clean":"2024-09-17T03:13:39.160062+0000","last_became_active":"2024-09-17T03:13:34.121581+0000","last_became_peered":"2024-09-17T03:13:34.121581+0000","last_unstale":"2024-09-17T03:13:39.160062+0000","last_undegraded":"2024-09-17T03:13:39.160062+0000","last_fullsized":"2024-09-17T03:13:39.160062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:13.154642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197789+0000","last_change":"2024-09-17T03:13:34.151296+0000","last_active":"2024-09-17T03:13:39.197789+0000","last_peered":"2024-09-17T03:13:39.197789+0000","last_clean":"2024-09-17T03:13:39.197789+0000","last_became_active":"2024-09-17T03:13:34.150833+0000","last_became_peered":"2024-09-17T03:13:34.150833+0000","last_unstale":"2024-09-17T03:13:39.197789+0000","last_undegraded":"2024-09-17T03:13:39.197789+0000","last_fullsized":"2024-09-17T03:13:39.197789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199481+0000","last_change":"2024-09-17T03:13:34.135844+0000","last_active":"2024-09-17T03:13:39.199481+0000","last_peered":"2024-09-17T03:13:39.199481+0000","last_clean":"2024-09-17T03:13:39.199481+0000","last_became_active":"2024-09-17T03:13:34.135484+0000","last_became_peered":"2024-09-17T03:13:34.135484+0000","last_unstale":"2024-09-17T03:13:39.199481+0000","last_undegraded":"2024-09-17T03:13:39.199481+0000","last_fullsized":"2024-09-17T03:13:39.199481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:39.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195346+0000","last_change":"2024-09-17T03:13:34.147615+0000","last_active":"2024-09-17T03:13:39.195346+0000","last_peered":"2024-09-17T03:13:39.195346+0000","last_clean":"2024-09-17T03:13:39.195346+0000","last_became_active":"2024-09-17T03:13:34.147373+0000","last_became_peered":"2024-09-17T03:13:34.147373+0000","last_unstale":"2024-09-17T03:13:39.195346+0000","last_undegraded":"2024-09-17T03:13:39.195346+0000","last_fullsized":"2024-09-17T03:13:39.195346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:00.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199570+0000","last_change":"2024-09-17T03:13:34.145347+0000","last_active":"2024-09-17T03:13:39.199570+0000","last_peered":"2024-09-17T03:13:39.199570+0000","last_clean":"2024-09-17T03:13:39.199570+0000","last_became_active":"2024-09-17T03:13:34.145057+0000","last_became_peered":"2024-09-17T03:13:34.145057+0000","last_unstale":"2024-09-17T03:13:39.199570+0000","last_undegraded":"2024-09-17T03:13:39.199570+0000","last_fullsized":"2024-09-17T03:13:39.199570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:29.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196508+0000","last_change":"2024-09-17T03:13:34.127450+0000","last_active":"2024-09-17T03:13:39.196508+0000","last_peered":"2024-09-17T03:13:39.196508+0000","last_clean":"2024-09-17T03:13:39.196508+0000","last_became_active":"2024-09-17T03:13:34.127169+0000","last_became_peered":"2024-09-17T03:13:34.127169+0000","last_unstale":"2024-09-17T03:13:39.196508+0000","last_undegraded":"2024-09-17T03:13:39.196508+0000","last_fullsized":"2024-09-17T03:13:39.196508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157187+0000","last_change":"2024-09-17T03:13:34.148947+0000","last_active":"2024-09-17T03:13:39.157187+0000","last_peered":"2024-09-17T03:13:39.157187+0000","last_clean":"2024-09-17T03:13:39.157187+0000","last_became_active":"2024-09-17T03:13:34.148584+0000","last_became_peered":"2024-09-17T03:13:34.148584+0000","last_unstale":"2024-09-17T03:13:39.157187+0000","last_undegraded":"2024-09-17T03:13:39.157187+0000","last_fullsized":"2024-09-17T03:13:39.157187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157720+0000","last_change":"2024-09-17T03:13:34.138509+0000","last_active":"2024-09-17T03:13:39.157720+0000","last_peered":"2024-09-17T03:13:39.157720+0000","last_clean":"2024-09-17T03:13:39.157720+0000","last_became_active":"2024-09-17T03:13:34.137862+0000","last_became_peered":"2024-09-17T03:13:34.137862+0000","last_unstale":"2024-09-17T03:13:39.157720+0000","last_undegraded":"2024-09-17T03:13:39.157720+0000","last_fullsized":"2024-09-17T03:13:39.157720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.125892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158457+0000","last_change":"2024-09-17T03:13:34.148276+0000","last_active":"2024-09-17T03:13:39.158457+0000","last_peered":"2024-09-17T03:13:39.158457+0000","last_clean":"2024-09-17T03:13:39.158457+0000","last_became_active":"2024-09-17T03:13:34.148053+0000","last_became_peered":"2024-09-17T03:13:34.148053+0000","last_unstale":"2024-09-17T03:13:39.158457+0000","last_undegraded":"2024-09-17T03:13:39.158457+0000","last_fullsized":"2024-09-17T03:13:39.158457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:23.791285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197786+0000","last_change":"2024-09-17T03:13:34.151106+0000","last_active":"2024-09-17T03:13:39.197786+0000","last_peered":"2024-09-17T03:13:39.197786+0000","last_clean":"2024-09-17T03:13:39.197786+0000","last_became_active":"2024-09-17T03:13:34.150584+0000","last_became_peered":"2024-09-17T03:13:34.150584+0000","last_unstale":"2024-09-17T03:13:39.197786+0000","last_undegraded":"2024-09-17T03:13:39.197786+0000","last_fullsized":"2024-09-17T03:13:39.197786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:11.890092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197394+0000","last_change":"2024-09-17T03:13:34.141641+0000","last_active":"2024-09-17T03:13:39.197394+0000","last_peered":"2024-09-17T03:13:39.197394+0000","last_clean":"2024-09-17T03:13:39.197394+0000","last_became_active":"2024-09-17T03:13:34.141338+0000","last_became_peered":"2024-09-17T03:13:34.141338+0000","last_unstale":"2024-09-17T03:13:39.197394+0000","last_undegraded":"2024-09-17T03:13:39.197394+0000","last_fullsized":"2024-09-17T03:13:39.197394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:35.475292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197098+0000","last_change":"2024-09-17T03:13:34.150804+0000","last_active":"2024-09-17T03:13:39.197098+0000","last_peered":"2024-09-17T03:13:39.197098+0000","last_clean":"2024-09-17T03:13:39.197098+0000","last_became_active":"2024-09-17T03:13:34.150486+0000","last_became_peered":"2024-09-17T03:13:34.150486+0000","last_unstale":"2024-09-17T03:13:39.197098+0000","last_undegraded":"2024-09-17T03:13:39.197098+0000","last_fullsized":"2024-09-17T03:13:39.197098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:18.029333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197517+0000","last_change":"2024-09-17T03:13:34.131477+0000","last_active":"2024-09-17T03:13:39.197517+0000","last_peered":"2024-09-17T03:13:39.197517+0000","last_clean":"2024-09-17T03:13:39.197517+0000","last_became_active":"2024-09-17T03:13:34.130564+0000","last_became_peered":"2024-09-17T03:13:34.130564+0000","last_unstale":"2024-09-17T03:13:39.197517+0000","last_undegraded":"2024-09-17T03:13:39.197517+0000","last_fullsized":"2024-09-17T03:13:39.197517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:34.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157103+0000","last_change":"2024-09-17T03:13:34.142799+0000","last_active":"2024-09-17T03:13:39.157103+0000","last_peered":"2024-09-17T03:13:39.157103+0000","last_clean":"2024-09-17T03:13:39.157103+0000","last_became_active":"2024-09-17T03:13:34.142494+0000","last_became_peered":"2024-09-17T03:13:34.142494+0000","last_unstale":"2024-09-17T03:13:39.157103+0000","last_undegraded":"2024-09-17T03:13:39.157103+0000","last_fullsized":"2024-09-17T03:13:39.157103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.778912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194970+0000","last_change":"2024-09-17T03:13:34.141400+0000","last_active":"2024-09-17T03:13:39.194970+0000","last_peered":"2024-09-17T03:13:39.194970+0000","last_clean":"2024-09-17T03:13:39.194970+0000","last_became_active":"2024-09-17T03:13:34.141088+0000","last_became_peered":"2024-09-17T03:13:34.141088+0000","last_unstale":"2024-09-17T03:13:39.194970+0000","last_undegraded":"2024-09-17T03:13:39.194970+0000","last_fullsized":"2024-09-17T03:13:39.194970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:34.516649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196351+0000","last_change":"2024-09-17T03:13:34.118085+0000","last_active":"2024-09-17T03:13:39.196351+0000","last_peered":"2024-09-17T03:13:39.196351+0000","last_clean":"2024-09-17T03:13:39.196351+0000","last_became_active":"2024-09-17T03:13:34.117665+0000","last_became_peered":"2024-09-17T03:13:34.117665+0000","last_unstale":"2024-09-17T03:13:39.196351+0000","last_undegraded":"2024-09-17T03:13:39.196351+0000","last_fullsized":"2024-09-17T03:13:39.196351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:31.700785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196520+0000","last_change":"2024-09-17T03:13:34.134663+0000","last_active":"2024-09-17T03:13:39.196520+0000","last_peered":"2024-09-17T03:13:39.196520+0000","last_clean":"2024-09-17T03:13:39.196520+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.196520+0000","last_undegraded":"2024-09-17T03:13:39.196520+0000","last_fullsized":"2024-09-17T03:13:39.196520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:54.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195773+0000","last_change":"2024-09-17T03:13:34.116909+0000","last_active":"2024-09-17T03:13:39.195773+0000","last_peered":"2024-09-17T03:13:39.195773+0000","last_clean":"2024-09-17T03:13:39.195773+0000","last_became_active":"2024-09-17T03:13:34.115590+0000","last_became_peered":"2024-09-17T03:13:34.115590+0000","last_unstale":"2024-09-17T03:13:39.195773+0000","last_undegraded":"2024-09-17T03:13:39.195773+0000","last_fullsized":"2024-09-17T03:13:39.195773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.277899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159836+0000","last_change":"2024-09-17T03:13:34.135845+0000","last_active":"2024-09-17T03:13:39.159836+0000","last_peered":"2024-09-17T03:13:39.159836+0000","last_clean":"2024-09-17T03:13:39.159836+0000","last_became_active":"2024-09-17T03:13:34.135526+0000","last_became_peered":"2024-09-17T03:13:34.135526+0000","last_unstale":"2024-09-17T03:13:39.159836+0000","last_undegraded":"2024-09-17T03:13:39.159836+0000","last_fullsized":"2024-09-17T03:13:39.159836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159196+0000","last_change":"2024-09-17T03:13:34.136523+0000","last_active":"2024-09-17T03:13:39.159196+0000","last_peered":"2024-09-17T03:13:39.159196+0000","last_clean":"2024-09-17T03:13:39.159196+0000","last_became_active":"2024-09-17T03:13:34.136202+0000","last_became_peered":"2024-09-17T03:13:34.136202+0000","last_unstale":"2024-09-17T03:13:39.159196+0000","last_undegraded":"2024-09-17T03:13:39.159196+0000","last_fullsized":"2024-09-17T03:13:39.159196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198096+0000","last_change":"2024-09-17T03:13:34.145425+0000","last_active":"2024-09-17T03:13:39.198096+0000","last_peered":"2024-09-17T03:13:39.198096+0000","last_clean":"2024-09-17T03:13:39.198096+0000","last_became_active":"2024-09-17T03:13:34.144888+0000","last_became_peered":"2024-09-17T03:13:34.144888+0000","last_unstale":"2024-09-17T03:13:39.198096+0000","last_undegraded":"2024-09-17T03:13:39.198096+0000","last_fullsized":"2024-09-17T03:13:39.198096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2859,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":114170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":112019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":113498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:52.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:52.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 -- 172.21.15.153:0/3755933988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 msgr2=0x7f3ff80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 --2- 172.21.15.153:0/3755933988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80cc020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8076360 tx=0x7f3fe802a540 comp rx=0 tx=0).stop 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 -- 172.21.15.153:0/3755933988 shutdown_connections 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 --2- 172.21.15.153:0/3755933988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80cc020 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 --2- 172.21.15.153:0/3755933988 >> v2:172.21.15.164:3300/0 conn(0x7f3ff8074cb0 0x7f3ff8073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 -- 172.21.15.153:0/3755933988 >> 172.21.15.153:0/3755933988 conn(0x7f3ff80cca40 msgr2=0x7f3ff80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 -- 172.21.15.153:0/3755933988 shutdown_connections 2024-09-17T03:13:52.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.895+0000 7f4000800640 1 -- 172.21.15.153:0/3755933988 wait complete. 2024-09-17T03:13:52.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.897+0000 7f4000800640 1 Processor -- start 2024-09-17T03:13:52.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.898+0000 7f4000800640 1 -- start start 2024-09-17T03:13:52.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff806ddf0 0x7f3ff8157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff8074cb0 0x7f3ff80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff806f360 con 0x7f3ff80cbc10 2024-09-17T03:13:52.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff806f1e0 con 0x7f3ff806ddf0 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f4000800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff806f4e0 con 0x7f3ff8074cb0 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f3ffe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f3ffe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57028/0 (socket says 172.21.15.153:57028) 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f3ffe800640 1 -- 172.21.15.153:0/4035551491 learned_addr learned my addr 172.21.15.153:0/4035551491 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f3ffd400640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff8074cb0 0x7f3ff80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.899+0000 7f3ffde00640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff806ddf0 0x7f3ff8157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 -- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff8074cb0 msgr2=0x7f3ff80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff8074cb0 0x7f3ff80c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 -- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff806ddf0 msgr2=0x7f3ff8157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff806ddf0 0x7f3ff8157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 -- 172.21.15.153:0/4035551491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff8157be0 con 0x7f3ff80cbc10 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ffe800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c730 tx=0x7f3ff400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4017070 con 0x7f3ff80cbc10 2024-09-17T03:13:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ff4003c60 con 0x7f3ff80cbc10 2024-09-17T03:13:52.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40052d0 con 0x7f3ff80cbc10 2024-09-17T03:13:52.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.900+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff80c8f50 con 0x7f3ff80cbc10 2024-09-17T03:13:52.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.901+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81f6520 con 0x7f3ff80cbc10 2024-09-17T03:13:52.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.902+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff806f990 con 0x7f3ff80cbc10 2024-09-17T03:13:52.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.903+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ff401a070 con 0x7f3ff80cbc10 2024-09-17T03:13:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.904+0000 7f3ff2000640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 0x7f3fdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.904+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3ff409a7b0 con 0x7f3ff80cbc10 2024-09-17T03:13:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.904+0000 7f3ffde00640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 0x7f3fdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.905+0000 7f3ffde00640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 0x7f3fdc07b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ff815a730 tx=0x7f3fec00b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:52.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:52.908+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ff4062250 con 0x7f3ff80cbc10 2024-09-17T03:13:53.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.091+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ff80ca380 con 0x7f3fdc078bc0 2024-09-17T03:13:53.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.097+0000 7f3ff2000640 1 -- 172.21.15.153:0/4035551491 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332555 (secure 0 0 0) 0x7f3ff80ca380 con 0x7f3fdc078bc0 2024-09-17T03:13:53.100 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:53.102 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:13:53.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 msgr2=0x7f3fdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 0x7f3fdc07b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ff815a730 tx=0x7f3fec00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 msgr2=0x7f3ff80c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c730 tx=0x7f3ff400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 shutdown_connections 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3fdc078bc0 0x7f3fdc07b0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80cbc10 0x7f3ff80c9970 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ff8074cb0 0x7f3ff80c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 --2- 172.21.15.153:0/4035551491 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ff806ddf0 0x7f3ff8157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.102+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 >> 172.21.15.153:0/4035551491 conn(0x7f3ff80cca40 msgr2=0x7f3ff80cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.103+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 shutdown_connections 2024-09-17T03:13:53.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.103+0000 7f4000800640 1 -- 172.21.15.153:0/4035551491 wait complete. 2024-09-17T03:13:53.123 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-17T03:13:52.821274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3514368,"data_stored":2081512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003458"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160943+0000","last_change":"2024-09-17T03:13:33.123350+0000","last_active":"2024-09-17T03:13:39.160943+0000","last_peered":"2024-09-17T03:13:39.160943+0000","last_clean":"2024-09-17T03:13:39.160943+0000","last_became_active":"2024-09-17T03:13:33.122982+0000","last_became_peered":"2024-09-17T03:13:33.122982+0000","last_unstale":"2024-09-17T03:13:39.160943+0000","last_undegraded":"2024-09-17T03:13:39.160943+0000","last_fullsized":"2024-09-17T03:13:39.160943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.030877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159339+0000","last_change":"2024-09-17T03:13:34.133910+0000","last_active":"2024-09-17T03:13:39.159339+0000","last_peered":"2024-09-17T03:13:39.159339+0000","last_clean":"2024-09-17T03:13:39.159339+0000","last_became_active":"2024-09-17T03:13:34.133495+0000","last_became_peered":"2024-09-17T03:13:34.133495+0000","last_unstale":"2024-09-17T03:13:39.159339+0000","last_undegraded":"2024-09-17T03:13:39.159339+0000","last_fullsized":"2024-09-17T03:13:39.159339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:06.942420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194823+0000","last_change":"2024-09-17T03:13:38.178584+0000","last_active":"2024-09-17T03:13:39.194823+0000","last_peered":"2024-09-17T03:13:39.194823+0000","last_clean":"2024-09-17T03:13:39.194823+0000","last_became_active":"2024-09-17T03:13:38.176304+0000","last_became_peered":"2024-09-17T03:13:38.176304+0000","last_unstale":"2024-09-17T03:13:39.194823+0000","last_undegraded":"2024-09-17T03:13:39.194823+0000","last_fullsized":"2024-09-17T03:13:39.194823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:12.541698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159446+0000","last_change":"2024-09-17T03:13:33.127434+0000","last_active":"2024-09-17T03:13:39.159446+0000","last_peered":"2024-09-17T03:13:39.159446+0000","last_clean":"2024-09-17T03:13:39.159446+0000","last_became_active":"2024-09-17T03:13:33.127048+0000","last_became_peered":"2024-09-17T03:13:33.127048+0000","last_unstale":"2024-09-17T03:13:39.159446+0000","last_undegraded":"2024-09-17T03:13:39.159446+0000","last_fullsized":"2024-09-17T03:13:39.159446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159903+0000","last_change":"2024-09-17T03:13:34.133739+0000","last_active":"2024-09-17T03:13:39.159903+0000","last_peered":"2024-09-17T03:13:39.159903+0000","last_clean":"2024-09-17T03:13:39.159903+0000","last_became_active":"2024-09-17T03:13:34.132902+0000","last_became_peered":"2024-09-17T03:13:34.132902+0000","last_unstale":"2024-09-17T03:13:39.159903+0000","last_undegraded":"2024-09-17T03:13:39.159903+0000","last_fullsized":"2024-09-17T03:13:39.159903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194767+0000","last_change":"2024-09-17T03:13:38.169585+0000","last_active":"2024-09-17T03:13:39.194767+0000","last_peered":"2024-09-17T03:13:39.194767+0000","last_clean":"2024-09-17T03:13:39.194767+0000","last_became_active":"2024-09-17T03:13:38.169149+0000","last_became_peered":"2024-09-17T03:13:38.169149+0000","last_unstale":"2024-09-17T03:13:39.194767+0000","last_undegraded":"2024-09-17T03:13:39.194767+0000","last_fullsized":"2024-09-17T03:13:39.194767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.817523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197699+0000","last_change":"2024-09-17T03:13:33.136982+0000","last_active":"2024-09-17T03:13:39.197699+0000","last_peered":"2024-09-17T03:13:39.197699+0000","last_clean":"2024-09-17T03:13:39.197699+0000","last_became_active":"2024-09-17T03:13:33.136263+0000","last_became_peered":"2024-09-17T03:13:33.136263+0000","last_unstale":"2024-09-17T03:13:39.197699+0000","last_undegraded":"2024-09-17T03:13:39.197699+0000","last_fullsized":"2024-09-17T03:13:39.197699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:15.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195911+0000","last_change":"2024-09-17T03:13:34.131912+0000","last_active":"2024-09-17T03:13:39.195911+0000","last_peered":"2024-09-17T03:13:39.195911+0000","last_clean":"2024-09-17T03:13:39.195911+0000","last_became_active":"2024-09-17T03:13:34.130908+0000","last_became_peered":"2024-09-17T03:13:34.130908+0000","last_unstale":"2024-09-17T03:13:39.195911+0000","last_undegraded":"2024-09-17T03:13:39.195911+0000","last_fullsized":"2024-09-17T03:13:39.195911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:09.565865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196018+0000","last_change":"2024-09-17T03:13:38.170051+0000","last_active":"2024-09-17T03:13:39.196018+0000","last_peered":"2024-09-17T03:13:39.196018+0000","last_clean":"2024-09-17T03:13:39.196018+0000","last_became_active":"2024-09-17T03:13:38.169083+0000","last_became_peered":"2024-09-17T03:13:38.169083+0000","last_unstale":"2024-09-17T03:13:39.196018+0000","last_undegraded":"2024-09-17T03:13:39.196018+0000","last_fullsized":"2024-09-17T03:13:39.196018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:53.571359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197904+0000","last_change":"2024-09-17T03:13:33.132790+0000","last_active":"2024-09-17T03:13:39.197904+0000","last_peered":"2024-09-17T03:13:39.197904+0000","last_clean":"2024-09-17T03:13:39.197904+0000","last_became_active":"2024-09-17T03:13:33.132482+0000","last_became_peered":"2024-09-17T03:13:33.132482+0000","last_unstale":"2024-09-17T03:13:39.197904+0000","last_undegraded":"2024-09-17T03:13:39.197904+0000","last_fullsized":"2024-09-17T03:13:39.197904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:36.557061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199238+0000","last_change":"2024-09-17T03:13:34.152246+0000","last_active":"2024-09-17T03:13:39.199238+0000","last_peered":"2024-09-17T03:13:39.199238+0000","last_clean":"2024-09-17T03:13:39.199238+0000","last_became_active":"2024-09-17T03:13:34.151761+0000","last_became_peered":"2024-09-17T03:13:34.151761+0000","last_unstale":"2024-09-17T03:13:39.199238+0000","last_undegraded":"2024-09-17T03:13:39.199238+0000","last_fullsized":"2024-09-17T03:13:39.199238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:55.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195385+0000","last_change":"2024-09-17T03:13:38.182362+0000","last_active":"2024-09-17T03:13:39.195385+0000","last_peered":"2024-09-17T03:13:39.195385+0000","last_clean":"2024-09-17T03:13:39.195385+0000","last_became_active":"2024-09-17T03:13:38.181949+0000","last_became_peered":"2024-09-17T03:13:38.181949+0000","last_unstale":"2024-09-17T03:13:39.195385+0000","last_undegraded":"2024-09-17T03:13:39.195385+0000","last_fullsized":"2024-09-17T03:13:39.195385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:21.583400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198556+0000","last_change":"2024-09-17T03:13:34.130957+0000","last_active":"2024-09-17T03:13:39.198556+0000","last_peered":"2024-09-17T03:13:39.198556+0000","last_clean":"2024-09-17T03:13:39.198556+0000","last_became_active":"2024-09-17T03:13:34.130643+0000","last_became_peered":"2024-09-17T03:13:34.130643+0000","last_unstale":"2024-09-17T03:13:39.198556+0000","last_undegraded":"2024-09-17T03:13:39.198556+0000","last_fullsized":"2024-09-17T03:13:39.198556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:30.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198915+0000","last_change":"2024-09-17T03:13:33.121803+0000","last_active":"2024-09-17T03:13:39.198915+0000","last_peered":"2024-09-17T03:13:39.198915+0000","last_clean":"2024-09-17T03:13:39.198915+0000","last_became_active":"2024-09-17T03:13:33.121396+0000","last_became_peered":"2024-09-17T03:13:33.121396+0000","last_unstale":"2024-09-17T03:13:39.198915+0000","last_undegraded":"2024-09-17T03:13:39.198915+0000","last_fullsized":"2024-09-17T03:13:39.198915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199170+0000","last_change":"2024-09-17T03:13:38.182273+0000","last_active":"2024-09-17T03:13:39.199170+0000","last_peered":"2024-09-17T03:13:39.199170+0000","last_clean":"2024-09-17T03:13:39.199170+0000","last_became_active":"2024-09-17T03:13:38.177607+0000","last_became_peered":"2024-09-17T03:13:38.177607+0000","last_unstale":"2024-09-17T03:13:39.199170+0000","last_undegraded":"2024-09-17T03:13:39.199170+0000","last_fullsized":"2024-09-17T03:13:39.199170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:00.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194949+0000","last_change":"2024-09-17T03:13:34.143115+0000","last_active":"2024-09-17T03:13:39.194949+0000","last_peered":"2024-09-17T03:13:39.194949+0000","last_clean":"2024-09-17T03:13:39.194949+0000","last_became_active":"2024-09-17T03:13:34.142792+0000","last_became_peered":"2024-09-17T03:13:34.142792+0000","last_unstale":"2024-09-17T03:13:39.194949+0000","last_undegraded":"2024-09-17T03:13:39.194949+0000","last_fullsized":"2024-09-17T03:13:39.194949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:16.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158223+0000","last_change":"2024-09-17T03:13:33.119000+0000","last_active":"2024-09-17T03:13:39.158223+0000","last_peered":"2024-09-17T03:13:39.158223+0000","last_clean":"2024-09-17T03:13:39.158223+0000","last_became_active":"2024-09-17T03:13:33.118137+0000","last_became_peered":"2024-09-17T03:13:33.118137+0000","last_unstale":"2024-09-17T03:13:39.158223+0000","last_undegraded":"2024-09-17T03:13:39.158223+0000","last_fullsized":"2024-09-17T03:13:39.158223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:48.663689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197652+0000","last_change":"2024-09-17T03:13:38.169936+0000","last_active":"2024-09-17T03:13:39.197652+0000","last_peered":"2024-09-17T03:13:39.197652+0000","last_clean":"2024-09-17T03:13:39.197652+0000","last_became_active":"2024-09-17T03:13:38.169497+0000","last_became_peered":"2024-09-17T03:13:38.169497+0000","last_unstale":"2024-09-17T03:13:39.197652+0000","last_undegraded":"2024-09-17T03:13:39.197652+0000","last_fullsized":"2024-09-17T03:13:39.197652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:41.815068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160080+0000","last_change":"2024-09-17T03:13:34.140522+0000","last_active":"2024-09-17T03:13:39.160080+0000","last_peered":"2024-09-17T03:13:39.160080+0000","last_clean":"2024-09-17T03:13:39.160080+0000","last_became_active":"2024-09-17T03:13:34.140149+0000","last_became_peered":"2024-09-17T03:13:34.140149+0000","last_unstale":"2024-09-17T03:13:39.160080+0000","last_undegraded":"2024-09-17T03:13:39.160080+0000","last_fullsized":"2024-09-17T03:13:39.160080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:16.959470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161158+0000","last_change":"2024-09-17T03:13:33.137244+0000","last_active":"2024-09-17T03:13:39.161158+0000","last_peered":"2024-09-17T03:13:39.161158+0000","last_clean":"2024-09-17T03:13:39.161158+0000","last_became_active":"2024-09-17T03:13:33.136903+0000","last_became_peered":"2024-09-17T03:13:33.136903+0000","last_unstale":"2024-09-17T03:13:39.161158+0000","last_undegraded":"2024-09-17T03:13:39.161158+0000","last_fullsized":"2024-09-17T03:13:39.161158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195505+0000","last_change":"2024-09-17T03:13:38.177994+0000","last_active":"2024-09-17T03:13:39.195505+0000","last_peered":"2024-09-17T03:13:39.195505+0000","last_clean":"2024-09-17T03:13:39.195505+0000","last_became_active":"2024-09-17T03:13:38.177478+0000","last_became_peered":"2024-09-17T03:13:38.177478+0000","last_unstale":"2024-09-17T03:13:39.195505+0000","last_undegraded":"2024-09-17T03:13:39.195505+0000","last_fullsized":"2024-09-17T03:13:39.195505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:12.414341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198055+0000","last_change":"2024-09-17T03:13:34.130179+0000","last_active":"2024-09-17T03:13:39.198055+0000","last_peered":"2024-09-17T03:13:39.198055+0000","last_clean":"2024-09-17T03:13:39.198055+0000","last_became_active":"2024-09-17T03:13:34.129884+0000","last_became_peered":"2024-09-17T03:13:34.129884+0000","last_unstale":"2024-09-17T03:13:39.198055+0000","last_undegraded":"2024-09-17T03:13:39.198055+0000","last_fullsized":"2024-09-17T03:13:39.198055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:50.196855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194458+0000","last_change":"2024-09-17T03:13:33.122054+0000","last_active":"2024-09-17T03:13:39.194458+0000","last_peered":"2024-09-17T03:13:39.194458+0000","last_clean":"2024-09-17T03:13:39.194458+0000","last_became_active":"2024-09-17T03:13:33.121698+0000","last_became_peered":"2024-09-17T03:13:33.121698+0000","last_unstale":"2024-09-17T03:13:39.194458+0000","last_undegraded":"2024-09-17T03:13:39.194458+0000","last_fullsized":"2024-09-17T03:13:39.194458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:57.578178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198044+0000","last_change":"2024-09-17T03:13:38.171631+0000","last_active":"2024-09-17T03:13:39.198044+0000","last_peered":"2024-09-17T03:13:39.198044+0000","last_clean":"2024-09-17T03:13:39.198044+0000","last_became_active":"2024-09-17T03:13:38.171240+0000","last_became_peered":"2024-09-17T03:13:38.171240+0000","last_unstale":"2024-09-17T03:13:39.198044+0000","last_undegraded":"2024-09-17T03:13:39.198044+0000","last_fullsized":"2024-09-17T03:13:39.198044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.719989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161020+0000","last_change":"2024-09-17T03:13:34.140177+0000","last_active":"2024-09-17T03:13:39.161020+0000","last_peered":"2024-09-17T03:13:39.161020+0000","last_clean":"2024-09-17T03:13:39.161020+0000","last_became_active":"2024-09-17T03:13:34.139841+0000","last_became_peered":"2024-09-17T03:13:34.139841+0000","last_unstale":"2024-09-17T03:13:39.161020+0000","last_undegraded":"2024-09-17T03:13:39.161020+0000","last_fullsized":"2024-09-17T03:13:39.161020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199584+0000","last_change":"2024-09-17T03:13:33.130507+0000","last_active":"2024-09-17T03:13:39.199584+0000","last_peered":"2024-09-17T03:13:39.199584+0000","last_clean":"2024-09-17T03:13:39.199584+0000","last_became_active":"2024-09-17T03:13:33.130209+0000","last_became_peered":"2024-09-17T03:13:33.130209+0000","last_unstale":"2024-09-17T03:13:39.199584+0000","last_undegraded":"2024-09-17T03:13:39.199584+0000","last_fullsized":"2024-09-17T03:13:39.199584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:15.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195482+0000","last_change":"2024-09-17T03:13:38.168304+0000","last_active":"2024-09-17T03:13:39.195482+0000","last_peered":"2024-09-17T03:13:39.195482+0000","last_clean":"2024-09-17T03:13:39.195482+0000","last_became_active":"2024-09-17T03:13:38.168009+0000","last_became_peered":"2024-09-17T03:13:38.168009+0000","last_unstale":"2024-09-17T03:13:39.195482+0000","last_undegraded":"2024-09-17T03:13:39.195482+0000","last_fullsized":"2024-09-17T03:13:39.195482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:37.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160808+0000","last_change":"2024-09-17T03:13:34.126671+0000","last_active":"2024-09-17T03:13:39.160808+0000","last_peered":"2024-09-17T03:13:39.160808+0000","last_clean":"2024-09-17T03:13:39.160808+0000","last_became_active":"2024-09-17T03:13:34.126376+0000","last_became_peered":"2024-09-17T03:13:34.126376+0000","last_unstale":"2024-09-17T03:13:39.160808+0000","last_undegraded":"2024-09-17T03:13:39.160808+0000","last_fullsized":"2024-09-17T03:13:39.160808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161109+0000","last_change":"2024-09-17T03:13:33.137148+0000","last_active":"2024-09-17T03:13:39.161109+0000","last_peered":"2024-09-17T03:13:39.161109+0000","last_clean":"2024-09-17T03:13:39.161109+0000","last_became_active":"2024-09-17T03:13:33.136897+0000","last_became_peered":"2024-09-17T03:13:33.136897+0000","last_unstale":"2024-09-17T03:13:39.161109+0000","last_undegraded":"2024-09-17T03:13:39.161109+0000","last_fullsized":"2024-09-17T03:13:39.161109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160118+0000","last_change":"2024-09-17T03:13:38.176096+0000","last_active":"2024-09-17T03:13:39.160118+0000","last_peered":"2024-09-17T03:13:39.160118+0000","last_clean":"2024-09-17T03:13:39.160118+0000","last_became_active":"2024-09-17T03:13:38.170721+0000","last_became_peered":"2024-09-17T03:13:38.170721+0000","last_unstale":"2024-09-17T03:13:39.160118+0000","last_undegraded":"2024-09-17T03:13:39.160118+0000","last_fullsized":"2024-09-17T03:13:39.160118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.067944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159455+0000","last_change":"2024-09-17T03:13:34.128263+0000","last_active":"2024-09-17T03:13:39.159455+0000","last_peered":"2024-09-17T03:13:39.159455+0000","last_clean":"2024-09-17T03:13:39.159455+0000","last_became_active":"2024-09-17T03:13:34.127855+0000","last_became_peered":"2024-09-17T03:13:34.127855+0000","last_unstale":"2024-09-17T03:13:39.159455+0000","last_undegraded":"2024-09-17T03:13:39.159455+0000","last_fullsized":"2024-09-17T03:13:39.159455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:48.610659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199587+0000","last_change":"2024-09-17T03:13:33.119090+0000","last_active":"2024-09-17T03:13:39.199587+0000","last_peered":"2024-09-17T03:13:39.199587+0000","last_clean":"2024-09-17T03:13:39.199587+0000","last_became_active":"2024-09-17T03:13:33.118370+0000","last_became_peered":"2024-09-17T03:13:33.118370+0000","last_unstale":"2024-09-17T03:13:39.199587+0000","last_undegraded":"2024-09-17T03:13:39.199587+0000","last_fullsized":"2024-09-17T03:13:39.199587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:40.438813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158397+0000","last_change":"2024-09-17T03:13:38.170311+0000","last_active":"2024-09-17T03:13:39.158397+0000","last_peered":"2024-09-17T03:13:39.158397+0000","last_clean":"2024-09-17T03:13:39.158397+0000","last_became_active":"2024-09-17T03:13:38.169794+0000","last_became_peered":"2024-09-17T03:13:38.169794+0000","last_unstale":"2024-09-17T03:13:39.158397+0000","last_undegraded":"2024-09-17T03:13:39.158397+0000","last_fullsized":"2024-09-17T03:13:39.158397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:47.182972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196860+0000","last_change":"2024-09-17T03:13:34.123331+0000","last_active":"2024-09-17T03:13:39.196860+0000","last_peered":"2024-09-17T03:13:39.196860+0000","last_clean":"2024-09-17T03:13:39.196860+0000","last_became_active":"2024-09-17T03:13:34.120225+0000","last_became_peered":"2024-09-17T03:13:34.120225+0000","last_unstale":"2024-09-17T03:13:39.196860+0000","last_undegraded":"2024-09-17T03:13:39.196860+0000","last_fullsized":"2024-09-17T03:13:39.196860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:15.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158326+0000","last_change":"2024-09-17T03:13:33.128407+0000","last_active":"2024-09-17T03:13:39.158326+0000","last_peered":"2024-09-17T03:13:39.158326+0000","last_clean":"2024-09-17T03:13:39.158326+0000","last_became_active":"2024-09-17T03:13:33.128078+0000","last_became_peered":"2024-09-17T03:13:33.128078+0000","last_unstale":"2024-09-17T03:13:39.158326+0000","last_undegraded":"2024-09-17T03:13:39.158326+0000","last_fullsized":"2024-09-17T03:13:39.158326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157547+0000","last_change":"2024-09-17T03:13:38.170011+0000","last_active":"2024-09-17T03:13:39.157547+0000","last_peered":"2024-09-17T03:13:39.157547+0000","last_clean":"2024-09-17T03:13:39.157547+0000","last_became_active":"2024-09-17T03:13:38.169510+0000","last_became_peered":"2024-09-17T03:13:38.169510+0000","last_unstale":"2024-09-17T03:13:39.157547+0000","last_undegraded":"2024-09-17T03:13:39.157547+0000","last_fullsized":"2024-09-17T03:13:39.157547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:32.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196289+0000","last_change":"2024-09-17T03:13:34.150966+0000","last_active":"2024-09-17T03:13:39.196289+0000","last_peered":"2024-09-17T03:13:39.196289+0000","last_clean":"2024-09-17T03:13:39.196289+0000","last_became_active":"2024-09-17T03:13:34.150654+0000","last_became_peered":"2024-09-17T03:13:34.150654+0000","last_unstale":"2024-09-17T03:13:39.196289+0000","last_undegraded":"2024-09-17T03:13:39.196289+0000","last_fullsized":"2024-09-17T03:13:39.196289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:41.752422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198782+0000","last_change":"2024-09-17T03:13:33.125357+0000","last_active":"2024-09-17T03:13:39.198782+0000","last_peered":"2024-09-17T03:13:39.198782+0000","last_clean":"2024-09-17T03:13:39.198782+0000","last_became_active":"2024-09-17T03:13:33.124855+0000","last_became_peered":"2024-09-17T03:13:33.124855+0000","last_unstale":"2024-09-17T03:13:39.198782+0000","last_undegraded":"2024-09-17T03:13:39.198782+0000","last_fullsized":"2024-09-17T03:13:39.198782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.725350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159207+0000","last_change":"2024-09-17T03:13:38.174646+0000","last_active":"2024-09-17T03:13:39.159207+0000","last_peered":"2024-09-17T03:13:39.159207+0000","last_clean":"2024-09-17T03:13:39.159207+0000","last_became_active":"2024-09-17T03:13:38.172014+0000","last_became_peered":"2024-09-17T03:13:38.172014+0000","last_unstale":"2024-09-17T03:13:39.159207+0000","last_undegraded":"2024-09-17T03:13:39.159207+0000","last_fullsized":"2024-09-17T03:13:39.159207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:00.671761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157242+0000","last_change":"2024-09-17T03:13:34.139654+0000","last_active":"2024-09-17T03:13:39.157242+0000","last_peered":"2024-09-17T03:13:39.157242+0000","last_clean":"2024-09-17T03:13:39.157242+0000","last_became_active":"2024-09-17T03:13:34.139302+0000","last_became_peered":"2024-09-17T03:13:34.139302+0000","last_unstale":"2024-09-17T03:13:39.157242+0000","last_undegraded":"2024-09-17T03:13:39.157242+0000","last_fullsized":"2024-09-17T03:13:39.157242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:17.544789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194921+0000","last_change":"2024-09-17T03:13:33.125260+0000","last_active":"2024-09-17T03:13:39.194921+0000","last_peered":"2024-09-17T03:13:39.194921+0000","last_clean":"2024-09-17T03:13:39.194921+0000","last_became_active":"2024-09-17T03:13:33.124837+0000","last_became_peered":"2024-09-17T03:13:33.124837+0000","last_unstale":"2024-09-17T03:13:39.194921+0000","last_undegraded":"2024-09-17T03:13:39.194921+0000","last_fullsized":"2024-09-17T03:13:39.194921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:23.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159089+0000","last_change":"2024-09-17T03:13:38.182098+0000","last_active":"2024-09-17T03:13:39.159089+0000","last_peered":"2024-09-17T03:13:39.159089+0000","last_clean":"2024-09-17T03:13:39.159089+0000","last_became_active":"2024-09-17T03:13:38.181677+0000","last_became_peered":"2024-09-17T03:13:38.181677+0000","last_unstale":"2024-09-17T03:13:39.159089+0000","last_undegraded":"2024-09-17T03:13:39.159089+0000","last_fullsized":"2024-09-17T03:13:39.159089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.122052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157898+0000","last_change":"2024-09-17T03:13:34.137074+0000","last_active":"2024-09-17T03:13:39.157898+0000","last_peered":"2024-09-17T03:13:39.157898+0000","last_clean":"2024-09-17T03:13:39.157898+0000","last_became_active":"2024-09-17T03:13:34.133966+0000","last_became_peered":"2024-09-17T03:13:34.133966+0000","last_unstale":"2024-09-17T03:13:39.157898+0000","last_undegraded":"2024-09-17T03:13:39.157898+0000","last_fullsized":"2024-09-17T03:13:39.157898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196689+0000","last_change":"2024-09-17T03:13:33.126182+0000","last_active":"2024-09-17T03:13:39.196689+0000","last_peered":"2024-09-17T03:13:39.196689+0000","last_clean":"2024-09-17T03:13:39.196689+0000","last_became_active":"2024-09-17T03:13:33.121972+0000","last_became_peered":"2024-09-17T03:13:33.121972+0000","last_unstale":"2024-09-17T03:13:39.196689+0000","last_undegraded":"2024-09-17T03:13:39.196689+0000","last_fullsized":"2024-09-17T03:13:39.196689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:42.270063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159179+0000","last_change":"2024-09-17T03:13:38.168583+0000","last_active":"2024-09-17T03:13:39.159179+0000","last_peered":"2024-09-17T03:13:39.159179+0000","last_clean":"2024-09-17T03:13:39.159179+0000","last_became_active":"2024-09-17T03:13:38.168090+0000","last_became_peered":"2024-09-17T03:13:38.168090+0000","last_unstale":"2024-09-17T03:13:39.159179+0000","last_undegraded":"2024-09-17T03:13:39.159179+0000","last_fullsized":"2024-09-17T03:13:39.159179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:54.235466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160787+0000","last_change":"2024-09-17T03:13:34.112239+0000","last_active":"2024-09-17T03:13:39.160787+0000","last_peered":"2024-09-17T03:13:39.160787+0000","last_clean":"2024-09-17T03:13:39.160787+0000","last_became_active":"2024-09-17T03:13:34.111911+0000","last_became_peered":"2024-09-17T03:13:34.111911+0000","last_unstale":"2024-09-17T03:13:39.160787+0000","last_undegraded":"2024-09-17T03:13:39.160787+0000","last_fullsized":"2024-09-17T03:13:39.160787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:08.503088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198916+0000","last_change":"2024-09-17T03:13:33.125715+0000","last_active":"2024-09-17T03:13:39.198916+0000","last_peered":"2024-09-17T03:13:39.198916+0000","last_clean":"2024-09-17T03:13:39.198916+0000","last_became_active":"2024-09-17T03:13:33.125194+0000","last_became_peered":"2024-09-17T03:13:33.125194+0000","last_unstale":"2024-09-17T03:13:39.198916+0000","last_undegraded":"2024-09-17T03:13:39.198916+0000","last_fullsized":"2024-09-17T03:13:39.198916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:19.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196858+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:13:39.196858+0000","last_peered":"2024-09-17T03:13:39.196858+0000","last_clean":"2024-09-17T03:13:39.196858+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:13:39.196858+0000","last_undegraded":"2024-09-17T03:13:39.196858+0000","last_fullsized":"2024-09-17T03:13:39.196858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199547+0000","last_change":"2024-09-17T03:13:38.167682+0000","last_active":"2024-09-17T03:13:39.199547+0000","last_peered":"2024-09-17T03:13:39.199547+0000","last_clean":"2024-09-17T03:13:39.199547+0000","last_became_active":"2024-09-17T03:13:38.167110+0000","last_became_peered":"2024-09-17T03:13:38.167110+0000","last_unstale":"2024-09-17T03:13:39.199547+0000","last_undegraded":"2024-09-17T03:13:39.199547+0000","last_fullsized":"2024-09-17T03:13:39.199547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:12.466588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199361+0000","last_change":"2024-09-17T03:13:34.131142+0000","last_active":"2024-09-17T03:13:39.199361+0000","last_peered":"2024-09-17T03:13:39.199361+0000","last_clean":"2024-09-17T03:13:39.199361+0000","last_became_active":"2024-09-17T03:13:34.130839+0000","last_became_peered":"2024-09-17T03:13:34.130839+0000","last_unstale":"2024-09-17T03:13:39.199361+0000","last_undegraded":"2024-09-17T03:13:39.199361+0000","last_fullsized":"2024-09-17T03:13:39.199361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:37.776457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159474+0000","last_change":"2024-09-17T03:13:33.133189+0000","last_active":"2024-09-17T03:13:39.159474+0000","last_peered":"2024-09-17T03:13:39.159474+0000","last_clean":"2024-09-17T03:13:39.159474+0000","last_became_active":"2024-09-17T03:13:33.132836+0000","last_became_peered":"2024-09-17T03:13:33.132836+0000","last_unstale":"2024-09-17T03:13:39.159474+0000","last_undegraded":"2024-09-17T03:13:39.159474+0000","last_fullsized":"2024-09-17T03:13:39.159474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:51.274515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196215+0000","last_change":"2024-09-17T03:13:38.183375+0000","last_active":"2024-09-17T03:13:39.196215+0000","last_peered":"2024-09-17T03:13:39.196215+0000","last_clean":"2024-09-17T03:13:39.196215+0000","last_became_active":"2024-09-17T03:13:38.182947+0000","last_became_peered":"2024-09-17T03:13:38.182947+0000","last_unstale":"2024-09-17T03:13:39.196215+0000","last_undegraded":"2024-09-17T03:13:39.196215+0000","last_fullsized":"2024-09-17T03:13:39.196215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.792778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197849+0000","last_change":"2024-09-17T03:13:34.142680+0000","last_active":"2024-09-17T03:13:39.197849+0000","last_peered":"2024-09-17T03:13:39.197849+0000","last_clean":"2024-09-17T03:13:39.197849+0000","last_became_active":"2024-09-17T03:13:34.142375+0000","last_became_peered":"2024-09-17T03:13:34.142375+0000","last_unstale":"2024-09-17T03:13:39.197849+0000","last_undegraded":"2024-09-17T03:13:39.197849+0000","last_fullsized":"2024-09-17T03:13:39.197849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160135+0000","last_change":"2024-09-17T03:13:33.121940+0000","last_active":"2024-09-17T03:13:39.160135+0000","last_peered":"2024-09-17T03:13:39.160135+0000","last_clean":"2024-09-17T03:13:39.160135+0000","last_became_active":"2024-09-17T03:13:33.121454+0000","last_became_peered":"2024-09-17T03:13:33.121454+0000","last_unstale":"2024-09-17T03:13:39.160135+0000","last_undegraded":"2024-09-17T03:13:39.160135+0000","last_fullsized":"2024-09-17T03:13:39.160135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158537+0000","last_change":"2024-09-17T03:13:38.175006+0000","last_active":"2024-09-17T03:13:39.158537+0000","last_peered":"2024-09-17T03:13:39.158537+0000","last_clean":"2024-09-17T03:13:39.158537+0000","last_became_active":"2024-09-17T03:13:38.174354+0000","last_became_peered":"2024-09-17T03:13:38.174354+0000","last_unstale":"2024-09-17T03:13:39.158537+0000","last_undegraded":"2024-09-17T03:13:39.158537+0000","last_fullsized":"2024-09-17T03:13:39.158537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:46.350871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198197+0000","last_change":"2024-09-17T03:13:34.134217+0000","last_active":"2024-09-17T03:13:39.198197+0000","last_peered":"2024-09-17T03:13:39.198197+0000","last_clean":"2024-09-17T03:13:39.198197+0000","last_became_active":"2024-09-17T03:13:34.133864+0000","last_became_peered":"2024-09-17T03:13:34.133864+0000","last_unstale":"2024-09-17T03:13:39.198197+0000","last_undegraded":"2024-09-17T03:13:39.198197+0000","last_fullsized":"2024-09-17T03:13:39.198197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.172692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160941+0000","last_change":"2024-09-17T03:13:33.126989+0000","last_active":"2024-09-17T03:13:39.160941+0000","last_peered":"2024-09-17T03:13:39.160941+0000","last_clean":"2024-09-17T03:13:39.160941+0000","last_became_active":"2024-09-17T03:13:33.126662+0000","last_became_peered":"2024-09-17T03:13:33.126662+0000","last_unstale":"2024-09-17T03:13:39.160941+0000","last_undegraded":"2024-09-17T03:13:39.160941+0000","last_fullsized":"2024-09-17T03:13:39.160941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196440+0000","last_change":"2024-09-17T03:13:38.171271+0000","last_active":"2024-09-17T03:13:39.196440+0000","last_peered":"2024-09-17T03:13:39.196440+0000","last_clean":"2024-09-17T03:13:39.196440+0000","last_became_active":"2024-09-17T03:13:38.170206+0000","last_became_peered":"2024-09-17T03:13:38.170206+0000","last_unstale":"2024-09-17T03:13:39.196440+0000","last_undegraded":"2024-09-17T03:13:39.196440+0000","last_fullsized":"2024-09-17T03:13:39.196440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.198605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197293+0000","last_change":"2024-09-17T03:13:34.140674+0000","last_active":"2024-09-17T03:13:39.197293+0000","last_peered":"2024-09-17T03:13:39.197293+0000","last_clean":"2024-09-17T03:13:39.197293+0000","last_became_active":"2024-09-17T03:13:34.140286+0000","last_became_peered":"2024-09-17T03:13:34.140286+0000","last_unstale":"2024-09-17T03:13:39.197293+0000","last_undegraded":"2024-09-17T03:13:39.197293+0000","last_fullsized":"2024-09-17T03:13:39.197293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:16.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198435+0000","last_change":"2024-09-17T03:13:33.129963+0000","last_active":"2024-09-17T03:13:39.198435+0000","last_peered":"2024-09-17T03:13:39.198435+0000","last_clean":"2024-09-17T03:13:39.198435+0000","last_became_active":"2024-09-17T03:13:33.128743+0000","last_became_peered":"2024-09-17T03:13:33.128743+0000","last_unstale":"2024-09-17T03:13:39.198435+0000","last_undegraded":"2024-09-17T03:13:39.198435+0000","last_fullsized":"2024-09-17T03:13:39.198435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:59.444297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195666+0000","last_change":"2024-09-17T03:13:38.174410+0000","last_active":"2024-09-17T03:13:39.195666+0000","last_peered":"2024-09-17T03:13:39.195666+0000","last_clean":"2024-09-17T03:13:39.195666+0000","last_became_active":"2024-09-17T03:13:38.168524+0000","last_became_peered":"2024-09-17T03:13:38.168524+0000","last_unstale":"2024-09-17T03:13:39.195666+0000","last_undegraded":"2024-09-17T03:13:39.195666+0000","last_fullsized":"2024-09-17T03:13:39.195666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:11.387448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198030+0000","last_change":"2024-09-17T03:13:34.129876+0000","last_active":"2024-09-17T03:13:39.198030+0000","last_peered":"2024-09-17T03:13:39.198030+0000","last_clean":"2024-09-17T03:13:39.198030+0000","last_became_active":"2024-09-17T03:13:34.128110+0000","last_became_peered":"2024-09-17T03:13:34.128110+0000","last_unstale":"2024-09-17T03:13:39.198030+0000","last_undegraded":"2024-09-17T03:13:39.198030+0000","last_fullsized":"2024-09-17T03:13:39.198030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:04.560173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160218+0000","last_change":"2024-09-17T03:13:33.125002+0000","last_active":"2024-09-17T03:13:39.160218+0000","last_peered":"2024-09-17T03:13:39.160218+0000","last_clean":"2024-09-17T03:13:39.160218+0000","last_became_active":"2024-09-17T03:13:33.124643+0000","last_became_peered":"2024-09-17T03:13:33.124643+0000","last_unstale":"2024-09-17T03:13:39.160218+0000","last_undegraded":"2024-09-17T03:13:39.160218+0000","last_fullsized":"2024-09-17T03:13:39.160218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159507+0000","last_change":"2024-09-17T03:13:38.171833+0000","last_active":"2024-09-17T03:13:39.159507+0000","last_peered":"2024-09-17T03:13:39.159507+0000","last_clean":"2024-09-17T03:13:39.159507+0000","last_became_active":"2024-09-17T03:13:38.171380+0000","last_became_peered":"2024-09-17T03:13:38.171380+0000","last_unstale":"2024-09-17T03:13:39.159507+0000","last_undegraded":"2024-09-17T03:13:39.159507+0000","last_fullsized":"2024-09-17T03:13:39.159507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:43.248158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196746+0000","last_change":"2024-09-17T03:13:34.127390+0000","last_active":"2024-09-17T03:13:39.196746+0000","last_peered":"2024-09-17T03:13:39.196746+0000","last_clean":"2024-09-17T03:13:39.196746+0000","last_became_active":"2024-09-17T03:13:34.126867+0000","last_became_peered":"2024-09-17T03:13:34.126867+0000","last_unstale":"2024-09-17T03:13:39.196746+0000","last_undegraded":"2024-09-17T03:13:39.196746+0000","last_fullsized":"2024-09-17T03:13:39.196746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:45.924771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195084+0000","last_change":"2024-09-17T03:13:33.134673+0000","last_active":"2024-09-17T03:13:39.195084+0000","last_peered":"2024-09-17T03:13:39.195084+0000","last_clean":"2024-09-17T03:13:39.195084+0000","last_became_active":"2024-09-17T03:13:33.134335+0000","last_became_peered":"2024-09-17T03:13:33.134335+0000","last_unstale":"2024-09-17T03:13:39.195084+0000","last_undegraded":"2024-09-17T03:13:39.195084+0000","last_fullsized":"2024-09-17T03:13:39.195084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:19.536470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159940+0000","last_change":"2024-09-17T03:13:38.170527+0000","last_active":"2024-09-17T03:13:39.159940+0000","last_peered":"2024-09-17T03:13:39.159940+0000","last_clean":"2024-09-17T03:13:39.159940+0000","last_became_active":"2024-09-17T03:13:38.170114+0000","last_became_peered":"2024-09-17T03:13:38.170114+0000","last_unstale":"2024-09-17T03:13:39.159940+0000","last_undegraded":"2024-09-17T03:13:39.159940+0000","last_fullsized":"2024-09-17T03:13:39.159940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.118342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197562+0000","last_change":"2024-09-17T03:13:34.145344+0000","last_active":"2024-09-17T03:13:39.197562+0000","last_peered":"2024-09-17T03:13:39.197562+0000","last_clean":"2024-09-17T03:13:39.197562+0000","last_became_active":"2024-09-17T03:13:34.145041+0000","last_became_peered":"2024-09-17T03:13:34.145041+0000","last_unstale":"2024-09-17T03:13:39.197562+0000","last_undegraded":"2024-09-17T03:13:39.197562+0000","last_fullsized":"2024-09-17T03:13:39.197562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:42.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198728+0000","last_change":"2024-09-17T03:13:33.125668+0000","last_active":"2024-09-17T03:13:39.198728+0000","last_peered":"2024-09-17T03:13:39.198728+0000","last_clean":"2024-09-17T03:13:39.198728+0000","last_became_active":"2024-09-17T03:13:33.125357+0000","last_became_peered":"2024-09-17T03:13:33.125357+0000","last_unstale":"2024-09-17T03:13:39.198728+0000","last_undegraded":"2024-09-17T03:13:39.198728+0000","last_fullsized":"2024-09-17T03:13:39.198728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.692949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159384+0000","last_change":"2024-09-17T03:13:38.174239+0000","last_active":"2024-09-17T03:13:39.159384+0000","last_peered":"2024-09-17T03:13:39.159384+0000","last_clean":"2024-09-17T03:13:39.159384+0000","last_became_active":"2024-09-17T03:13:38.171412+0000","last_became_peered":"2024-09-17T03:13:38.171412+0000","last_unstale":"2024-09-17T03:13:39.159384+0000","last_undegraded":"2024-09-17T03:13:39.159384+0000","last_fullsized":"2024-09-17T03:13:39.159384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:06.888462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157843+0000","last_change":"2024-09-17T03:13:34.125801+0000","last_active":"2024-09-17T03:13:39.157843+0000","last_peered":"2024-09-17T03:13:39.157843+0000","last_clean":"2024-09-17T03:13:39.157843+0000","last_became_active":"2024-09-17T03:13:34.125205+0000","last_became_peered":"2024-09-17T03:13:34.125205+0000","last_unstale":"2024-09-17T03:13:39.157843+0000","last_undegraded":"2024-09-17T03:13:39.157843+0000","last_fullsized":"2024-09-17T03:13:39.157843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195177+0000","last_change":"2024-09-17T03:13:33.139264+0000","last_active":"2024-09-17T03:13:39.195177+0000","last_peered":"2024-09-17T03:13:39.195177+0000","last_clean":"2024-09-17T03:13:39.195177+0000","last_became_active":"2024-09-17T03:13:33.138945+0000","last_became_peered":"2024-09-17T03:13:33.138945+0000","last_unstale":"2024-09-17T03:13:39.195177+0000","last_undegraded":"2024-09-17T03:13:39.195177+0000","last_fullsized":"2024-09-17T03:13:39.195177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:06.266580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199260+0000","last_change":"2024-09-17T03:13:38.179790+0000","last_active":"2024-09-17T03:13:39.199260+0000","last_peered":"2024-09-17T03:13:39.199260+0000","last_clean":"2024-09-17T03:13:39.199260+0000","last_became_active":"2024-09-17T03:13:38.176965+0000","last_became_peered":"2024-09-17T03:13:38.176965+0000","last_unstale":"2024-09-17T03:13:39.199260+0000","last_undegraded":"2024-09-17T03:13:39.199260+0000","last_fullsized":"2024-09-17T03:13:39.199260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.524936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197505+0000","last_change":"2024-09-17T03:13:34.150718+0000","last_active":"2024-09-17T03:13:39.197505+0000","last_peered":"2024-09-17T03:13:39.197505+0000","last_clean":"2024-09-17T03:13:39.197505+0000","last_became_active":"2024-09-17T03:13:34.150380+0000","last_became_peered":"2024-09-17T03:13:34.150380+0000","last_unstale":"2024-09-17T03:13:39.197505+0000","last_undegraded":"2024-09-17T03:13:39.197505+0000","last_fullsized":"2024-09-17T03:13:39.197505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:45.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:47.064052+0000","last_change":"2024-09-17T03:13:33.115018+0000","last_active":"2024-09-17T03:13:47.064052+0000","last_peered":"2024-09-17T03:13:47.064052+0000","last_clean":"2024-09-17T03:13:47.064052+0000","last_became_active":"2024-09-17T03:13:33.114688+0000","last_became_peered":"2024-09-17T03:13:33.114688+0000","last_unstale":"2024-09-17T03:13:47.064052+0000","last_undegraded":"2024-09-17T03:13:47.064052+0000","last_fullsized":"2024-09-17T03:13:47.064052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.942641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160669+0000","last_change":"2024-09-17T03:13:38.175179+0000","last_active":"2024-09-17T03:13:39.160669+0000","last_peered":"2024-09-17T03:13:39.160669+0000","last_clean":"2024-09-17T03:13:39.160669+0000","last_became_active":"2024-09-17T03:13:38.172867+0000","last_became_peered":"2024-09-17T03:13:38.172867+0000","last_unstale":"2024-09-17T03:13:39.160669+0000","last_undegraded":"2024-09-17T03:13:39.160669+0000","last_fullsized":"2024-09-17T03:13:39.160669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:37.361119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199202+0000","last_change":"2024-09-17T03:13:34.124140+0000","last_active":"2024-09-17T03:13:39.199202+0000","last_peered":"2024-09-17T03:13:39.199202+0000","last_clean":"2024-09-17T03:13:39.199202+0000","last_became_active":"2024-09-17T03:13:34.123830+0000","last_became_peered":"2024-09-17T03:13:34.123830+0000","last_unstale":"2024-09-17T03:13:39.199202+0000","last_undegraded":"2024-09-17T03:13:39.199202+0000","last_fullsized":"2024-09-17T03:13:39.199202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:33.119048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195209+0000","last_change":"2024-09-17T03:13:33.132508+0000","last_active":"2024-09-17T03:13:39.195209+0000","last_peered":"2024-09-17T03:13:39.195209+0000","last_clean":"2024-09-17T03:13:39.195209+0000","last_became_active":"2024-09-17T03:13:33.132171+0000","last_became_peered":"2024-09-17T03:13:33.132171+0000","last_unstale":"2024-09-17T03:13:39.195209+0000","last_undegraded":"2024-09-17T03:13:39.195209+0000","last_fullsized":"2024-09-17T03:13:39.195209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:24.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196268+0000","last_change":"2024-09-17T03:13:38.170462+0000","last_active":"2024-09-17T03:13:39.196268+0000","last_peered":"2024-09-17T03:13:39.196268+0000","last_clean":"2024-09-17T03:13:39.196268+0000","last_became_active":"2024-09-17T03:13:38.169604+0000","last_became_peered":"2024-09-17T03:13:38.169604+0000","last_unstale":"2024-09-17T03:13:39.196268+0000","last_undegraded":"2024-09-17T03:13:39.196268+0000","last_fullsized":"2024-09-17T03:13:39.196268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:40.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160025+0000","last_change":"2024-09-17T03:13:34.128238+0000","last_active":"2024-09-17T03:13:39.160025+0000","last_peered":"2024-09-17T03:13:39.160025+0000","last_clean":"2024-09-17T03:13:39.160025+0000","last_became_active":"2024-09-17T03:13:34.127900+0000","last_became_peered":"2024-09-17T03:13:34.127900+0000","last_unstale":"2024-09-17T03:13:39.160025+0000","last_undegraded":"2024-09-17T03:13:39.160025+0000","last_fullsized":"2024-09-17T03:13:39.160025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197209+0000","last_change":"2024-09-17T03:13:33.133386+0000","last_active":"2024-09-17T03:13:39.197209+0000","last_peered":"2024-09-17T03:13:39.197209+0000","last_clean":"2024-09-17T03:13:39.197209+0000","last_became_active":"2024-09-17T03:13:33.132496+0000","last_became_peered":"2024-09-17T03:13:33.132496+0000","last_unstale":"2024-09-17T03:13:39.197209+0000","last_undegraded":"2024-09-17T03:13:39.197209+0000","last_fullsized":"2024-09-17T03:13:39.197209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:53.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194730+0000","last_change":"2024-09-17T03:13:38.176141+0000","last_active":"2024-09-17T03:13:39.194730+0000","last_peered":"2024-09-17T03:13:39.194730+0000","last_clean":"2024-09-17T03:13:39.194730+0000","last_became_active":"2024-09-17T03:13:38.175441+0000","last_became_peered":"2024-09-17T03:13:38.175441+0000","last_unstale":"2024-09-17T03:13:39.194730+0000","last_undegraded":"2024-09-17T03:13:39.194730+0000","last_fullsized":"2024-09-17T03:13:39.194730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:24.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197192+0000","last_change":"2024-09-17T03:13:34.127326+0000","last_active":"2024-09-17T03:13:39.197192+0000","last_peered":"2024-09-17T03:13:39.197192+0000","last_clean":"2024-09-17T03:13:39.197192+0000","last_became_active":"2024-09-17T03:13:34.126960+0000","last_became_peered":"2024-09-17T03:13:34.126960+0000","last_unstale":"2024-09-17T03:13:39.197192+0000","last_undegraded":"2024-09-17T03:13:39.197192+0000","last_fullsized":"2024-09-17T03:13:39.197192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:05.699702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197544+0000","last_change":"2024-09-17T03:13:33.127320+0000","last_active":"2024-09-17T03:13:39.197544+0000","last_peered":"2024-09-17T03:13:39.197544+0000","last_clean":"2024-09-17T03:13:39.197544+0000","last_became_active":"2024-09-17T03:13:33.126979+0000","last_became_peered":"2024-09-17T03:13:33.126979+0000","last_unstale":"2024-09-17T03:13:39.197544+0000","last_undegraded":"2024-09-17T03:13:39.197544+0000","last_fullsized":"2024-09-17T03:13:39.197544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160474+0000","last_change":"2024-09-17T03:13:38.170474+0000","last_active":"2024-09-17T03:13:39.160474+0000","last_peered":"2024-09-17T03:13:39.160474+0000","last_clean":"2024-09-17T03:13:39.160474+0000","last_became_active":"2024-09-17T03:13:38.169227+0000","last_became_peered":"2024-09-17T03:13:38.169227+0000","last_unstale":"2024-09-17T03:13:39.160474+0000","last_undegraded":"2024-09-17T03:13:39.160474+0000","last_fullsized":"2024-09-17T03:13:39.160474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:39.513902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160847+0000","last_change":"2024-09-17T03:13:38.173752+0000","last_active":"2024-09-17T03:13:39.160847+0000","last_peered":"2024-09-17T03:13:39.160847+0000","last_clean":"2024-09-17T03:13:39.160847+0000","last_became_active":"2024-09-17T03:13:38.173339+0000","last_became_peered":"2024-09-17T03:13:38.173339+0000","last_unstale":"2024-09-17T03:13:39.160847+0000","last_undegraded":"2024-09-17T03:13:39.160847+0000","last_fullsized":"2024-09-17T03:13:39.160847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:49.042265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161197+0000","last_change":"2024-09-17T03:13:34.128858+0000","last_active":"2024-09-17T03:13:39.161197+0000","last_peered":"2024-09-17T03:13:39.161197+0000","last_clean":"2024-09-17T03:13:39.161197+0000","last_became_active":"2024-09-17T03:13:34.128470+0000","last_became_peered":"2024-09-17T03:13:34.128470+0000","last_unstale":"2024-09-17T03:13:39.161197+0000","last_undegraded":"2024-09-17T03:13:39.161197+0000","last_fullsized":"2024-09-17T03:13:39.161197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:20.842323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196620+0000","last_change":"2024-09-17T03:13:33.123650+0000","last_active":"2024-09-17T03:13:39.196620+0000","last_peered":"2024-09-17T03:13:39.196620+0000","last_clean":"2024-09-17T03:13:39.196620+0000","last_became_active":"2024-09-17T03:13:33.123336+0000","last_became_peered":"2024-09-17T03:13:33.123336+0000","last_unstale":"2024-09-17T03:13:39.196620+0000","last_undegraded":"2024-09-17T03:13:39.196620+0000","last_fullsized":"2024-09-17T03:13:39.196620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:22.478021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199452+0000","last_change":"2024-09-17T03:13:38.186350+0000","last_active":"2024-09-17T03:13:39.199452+0000","last_peered":"2024-09-17T03:13:39.199452+0000","last_clean":"2024-09-17T03:13:39.199452+0000","last_became_active":"2024-09-17T03:13:38.185605+0000","last_became_peered":"2024-09-17T03:13:38.185605+0000","last_unstale":"2024-09-17T03:13:39.199452+0000","last_undegraded":"2024-09-17T03:13:39.199452+0000","last_fullsized":"2024-09-17T03:13:39.199452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:12.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157345+0000","last_change":"2024-09-17T03:13:34.125368+0000","last_active":"2024-09-17T03:13:39.157345+0000","last_peered":"2024-09-17T03:13:39.157345+0000","last_clean":"2024-09-17T03:13:39.157345+0000","last_became_active":"2024-09-17T03:13:34.124883+0000","last_became_peered":"2024-09-17T03:13:34.124883+0000","last_unstale":"2024-09-17T03:13:39.157345+0000","last_undegraded":"2024-09-17T03:13:39.157345+0000","last_fullsized":"2024-09-17T03:13:39.157345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158046+0000","last_change":"2024-09-17T03:13:33.128441+0000","last_active":"2024-09-17T03:13:39.158046+0000","last_peered":"2024-09-17T03:13:39.158046+0000","last_clean":"2024-09-17T03:13:39.158046+0000","last_became_active":"2024-09-17T03:13:33.128152+0000","last_became_peered":"2024-09-17T03:13:33.128152+0000","last_unstale":"2024-09-17T03:13:39.158046+0000","last_undegraded":"2024-09-17T03:13:39.158046+0000","last_fullsized":"2024-09-17T03:13:39.158046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:06.006592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198671+0000","last_change":"2024-09-17T03:13:33.128570+0000","last_active":"2024-09-17T03:13:39.198671+0000","last_peered":"2024-09-17T03:13:39.198671+0000","last_clean":"2024-09-17T03:13:39.198671+0000","last_became_active":"2024-09-17T03:13:33.128178+0000","last_became_peered":"2024-09-17T03:13:33.128178+0000","last_unstale":"2024-09-17T03:13:39.198671+0000","last_undegraded":"2024-09-17T03:13:39.198671+0000","last_fullsized":"2024-09-17T03:13:39.198671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.359407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160314+0000","last_change":"2024-09-17T03:13:34.136349+0000","last_active":"2024-09-17T03:13:39.160314+0000","last_peered":"2024-09-17T03:13:39.160314+0000","last_clean":"2024-09-17T03:13:39.160314+0000","last_became_active":"2024-09-17T03:13:34.135978+0000","last_became_peered":"2024-09-17T03:13:34.135978+0000","last_unstale":"2024-09-17T03:13:39.160314+0000","last_undegraded":"2024-09-17T03:13:39.160314+0000","last_fullsized":"2024-09-17T03:13:39.160314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:08.375730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161237+0000","last_change":"2024-09-17T03:13:38.179343+0000","last_active":"2024-09-17T03:13:39.161237+0000","last_peered":"2024-09-17T03:13:39.161237+0000","last_clean":"2024-09-17T03:13:39.161237+0000","last_became_active":"2024-09-17T03:13:38.178868+0000","last_became_peered":"2024-09-17T03:13:38.178868+0000","last_unstale":"2024-09-17T03:13:39.161237+0000","last_undegraded":"2024-09-17T03:13:39.161237+0000","last_fullsized":"2024-09-17T03:13:39.161237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:58.731297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158741+0000","last_change":"2024-09-17T03:13:33.126321+0000","last_active":"2024-09-17T03:13:39.158741+0000","last_peered":"2024-09-17T03:13:39.158741+0000","last_clean":"2024-09-17T03:13:39.158741+0000","last_became_active":"2024-09-17T03:13:33.124412+0000","last_became_peered":"2024-09-17T03:13:33.124412+0000","last_unstale":"2024-09-17T03:13:39.158741+0000","last_undegraded":"2024-09-17T03:13:39.158741+0000","last_fullsized":"2024-09-17T03:13:39.158741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196954+0000","last_change":"2024-09-17T03:13:34.126417+0000","last_active":"2024-09-17T03:13:39.196954+0000","last_peered":"2024-09-17T03:13:39.196954+0000","last_clean":"2024-09-17T03:13:39.196954+0000","last_became_active":"2024-09-17T03:13:34.126094+0000","last_became_peered":"2024-09-17T03:13:34.126094+0000","last_unstale":"2024-09-17T03:13:39.196954+0000","last_undegraded":"2024-09-17T03:13:39.196954+0000","last_fullsized":"2024-09-17T03:13:39.196954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195295+0000","last_change":"2024-09-17T03:13:38.181805+0000","last_active":"2024-09-17T03:13:39.195295+0000","last_peered":"2024-09-17T03:13:39.195295+0000","last_clean":"2024-09-17T03:13:39.195295+0000","last_became_active":"2024-09-17T03:13:38.181287+0000","last_became_peered":"2024-09-17T03:13:38.181287+0000","last_unstale":"2024-09-17T03:13:39.195295+0000","last_undegraded":"2024-09-17T03:13:39.195295+0000","last_fullsized":"2024-09-17T03:13:39.195295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:17.193253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194766+0000","last_change":"2024-09-17T03:13:34.125233+0000","last_active":"2024-09-17T03:13:39.194766+0000","last_peered":"2024-09-17T03:13:39.194766+0000","last_clean":"2024-09-17T03:13:39.194766+0000","last_became_active":"2024-09-17T03:13:34.115962+0000","last_became_peered":"2024-09-17T03:13:34.115962+0000","last_unstale":"2024-09-17T03:13:39.194766+0000","last_undegraded":"2024-09-17T03:13:39.194766+0000","last_fullsized":"2024-09-17T03:13:39.194766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194622+0000","last_change":"2024-09-17T03:13:34.142202+0000","last_active":"2024-09-17T03:13:39.194622+0000","last_peered":"2024-09-17T03:13:39.194622+0000","last_clean":"2024-09-17T03:13:39.194622+0000","last_became_active":"2024-09-17T03:13:34.141894+0000","last_became_peered":"2024-09-17T03:13:34.141894+0000","last_unstale":"2024-09-17T03:13:39.194622+0000","last_undegraded":"2024-09-17T03:13:39.194622+0000","last_fullsized":"2024-09-17T03:13:39.194622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198442+0000","last_change":"2024-09-17T03:13:34.128354+0000","last_active":"2024-09-17T03:13:39.198442+0000","last_peered":"2024-09-17T03:13:39.198442+0000","last_clean":"2024-09-17T03:13:39.198442+0000","last_became_active":"2024-09-17T03:13:34.128064+0000","last_became_peered":"2024-09-17T03:13:34.128064+0000","last_unstale":"2024-09-17T03:13:39.198442+0000","last_undegraded":"2024-09-17T03:13:39.198442+0000","last_fullsized":"2024-09-17T03:13:39.198442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158623+0000","last_change":"2024-09-17T03:13:34.140919+0000","last_active":"2024-09-17T03:13:39.158623+0000","last_peered":"2024-09-17T03:13:39.158623+0000","last_clean":"2024-09-17T03:13:39.158623+0000","last_became_active":"2024-09-17T03:13:34.140561+0000","last_became_peered":"2024-09-17T03:13:34.140561+0000","last_unstale":"2024-09-17T03:13:39.158623+0000","last_undegraded":"2024-09-17T03:13:39.158623+0000","last_fullsized":"2024-09-17T03:13:39.158623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.397850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159371+0000","last_change":"2024-09-17T03:13:34.137429+0000","last_active":"2024-09-17T03:13:39.159371+0000","last_peered":"2024-09-17T03:13:39.159371+0000","last_clean":"2024-09-17T03:13:39.159371+0000","last_became_active":"2024-09-17T03:13:34.135149+0000","last_became_peered":"2024-09-17T03:13:34.135149+0000","last_unstale":"2024-09-17T03:13:39.159371+0000","last_undegraded":"2024-09-17T03:13:39.159371+0000","last_fullsized":"2024-09-17T03:13:39.159371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158439+0000","last_change":"2024-09-17T03:13:34.144580+0000","last_active":"2024-09-17T03:13:39.158439+0000","last_peered":"2024-09-17T03:13:39.158439+0000","last_clean":"2024-09-17T03:13:39.158439+0000","last_became_active":"2024-09-17T03:13:34.144100+0000","last_became_peered":"2024-09-17T03:13:34.144100+0000","last_unstale":"2024-09-17T03:13:39.158439+0000","last_undegraded":"2024-09-17T03:13:39.158439+0000","last_fullsized":"2024-09-17T03:13:39.158439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.561070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197089+0000","last_change":"2024-09-17T03:13:34.132354+0000","last_active":"2024-09-17T03:13:39.197089+0000","last_peered":"2024-09-17T03:13:39.197089+0000","last_clean":"2024-09-17T03:13:39.197089+0000","last_became_active":"2024-09-17T03:13:34.131250+0000","last_became_peered":"2024-09-17T03:13:34.131250+0000","last_unstale":"2024-09-17T03:13:39.197089+0000","last_undegraded":"2024-09-17T03:13:39.197089+0000","last_fullsized":"2024-09-17T03:13:39.197089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:41.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159577+0000","last_change":"2024-09-17T03:13:34.134701+0000","last_active":"2024-09-17T03:13:39.159577+0000","last_peered":"2024-09-17T03:13:39.159577+0000","last_clean":"2024-09-17T03:13:39.159577+0000","last_became_active":"2024-09-17T03:13:34.134341+0000","last_became_peered":"2024-09-17T03:13:34.134341+0000","last_unstale":"2024-09-17T03:13:39.159577+0000","last_undegraded":"2024-09-17T03:13:39.159577+0000","last_fullsized":"2024-09-17T03:13:39.159577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:36.866564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196579+0000","last_change":"2024-09-17T03:13:34.128615+0000","last_active":"2024-09-17T03:13:39.196579+0000","last_peered":"2024-09-17T03:13:39.196579+0000","last_clean":"2024-09-17T03:13:39.196579+0000","last_became_active":"2024-09-17T03:13:34.128116+0000","last_became_peered":"2024-09-17T03:13:34.128116+0000","last_unstale":"2024-09-17T03:13:39.196579+0000","last_undegraded":"2024-09-17T03:13:39.196579+0000","last_fullsized":"2024-09-17T03:13:39.196579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157351+0000","last_change":"2024-09-17T03:13:34.134305+0000","last_active":"2024-09-17T03:13:39.157351+0000","last_peered":"2024-09-17T03:13:39.157351+0000","last_clean":"2024-09-17T03:13:39.157351+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.157351+0000","last_undegraded":"2024-09-17T03:13:39.157351+0000","last_fullsized":"2024-09-17T03:13:39.157351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196833+0000","last_change":"2024-09-17T03:13:34.138279+0000","last_active":"2024-09-17T03:13:39.196833+0000","last_peered":"2024-09-17T03:13:39.196833+0000","last_clean":"2024-09-17T03:13:39.196833+0000","last_became_active":"2024-09-17T03:13:34.137706+0000","last_became_peered":"2024-09-17T03:13:34.137706+0000","last_unstale":"2024-09-17T03:13:39.196833+0000","last_undegraded":"2024-09-17T03:13:39.196833+0000","last_fullsized":"2024-09-17T03:13:39.196833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:02.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160062+0000","last_change":"2024-09-17T03:13:34.125660+0000","last_active":"2024-09-17T03:13:39.160062+0000","last_peered":"2024-09-17T03:13:39.160062+0000","last_clean":"2024-09-17T03:13:39.160062+0000","last_became_active":"2024-09-17T03:13:34.121581+0000","last_became_peered":"2024-09-17T03:13:34.121581+0000","last_unstale":"2024-09-17T03:13:39.160062+0000","last_undegraded":"2024-09-17T03:13:39.160062+0000","last_fullsized":"2024-09-17T03:13:39.160062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:13.154642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197789+0000","last_change":"2024-09-17T03:13:34.151296+0000","last_active":"2024-09-17T03:13:39.197789+0000","last_peered":"2024-09-17T03:13:39.197789+0000","last_clean":"2024-09-17T03:13:39.197789+0000","last_became_active":"2024-09-17T03:13:34.150833+0000","last_became_peered":"2024-09-17T03:13:34.150833+0000","last_unstale":"2024-09-17T03:13:39.197789+0000","last_undegraded":"2024-09-17T03:13:39.197789+0000","last_fullsized":"2024-09-17T03:13:39.197789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199481+0000","last_change":"2024-09-17T03:13:34.135844+0000","last_active":"2024-09-17T03:13:39.199481+0000","last_peered":"2024-09-17T03:13:39.199481+0000","last_clean":"2024-09-17T03:13:39.199481+0000","last_became_active":"2024-09-17T03:13:34.135484+0000","last_became_peered":"2024-09-17T03:13:34.135484+0000","last_unstale":"2024-09-17T03:13:39.199481+0000","last_undegraded":"2024-09-17T03:13:39.199481+0000","last_fullsized":"2024-09-17T03:13:39.199481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:39.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195346+0000","last_change":"2024-09-17T03:13:34.147615+0000","last_active":"2024-09-17T03:13:39.195346+0000","last_peered":"2024-09-17T03:13:39.195346+0000","last_clean":"2024-09-17T03:13:39.195346+0000","last_became_active":"2024-09-17T03:13:34.147373+0000","last_became_peered":"2024-09-17T03:13:34.147373+0000","last_unstale":"2024-09-17T03:13:39.195346+0000","last_undegraded":"2024-09-17T03:13:39.195346+0000","last_fullsized":"2024-09-17T03:13:39.195346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:00.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199570+0000","last_change":"2024-09-17T03:13:34.145347+0000","last_active":"2024-09-17T03:13:39.199570+0000","last_peered":"2024-09-17T03:13:39.199570+0000","last_clean":"2024-09-17T03:13:39.199570+0000","last_became_active":"2024-09-17T03:13:34.145057+0000","last_became_peered":"2024-09-17T03:13:34.145057+0000","last_unstale":"2024-09-17T03:13:39.199570+0000","last_undegraded":"2024-09-17T03:13:39.199570+0000","last_fullsized":"2024-09-17T03:13:39.199570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:29.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196508+0000","last_change":"2024-09-17T03:13:34.127450+0000","last_active":"2024-09-17T03:13:39.196508+0000","last_peered":"2024-09-17T03:13:39.196508+0000","last_clean":"2024-09-17T03:13:39.196508+0000","last_became_active":"2024-09-17T03:13:34.127169+0000","last_became_peered":"2024-09-17T03:13:34.127169+0000","last_unstale":"2024-09-17T03:13:39.196508+0000","last_undegraded":"2024-09-17T03:13:39.196508+0000","last_fullsized":"2024-09-17T03:13:39.196508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157187+0000","last_change":"2024-09-17T03:13:34.148947+0000","last_active":"2024-09-17T03:13:39.157187+0000","last_peered":"2024-09-17T03:13:39.157187+0000","last_clean":"2024-09-17T03:13:39.157187+0000","last_became_active":"2024-09-17T03:13:34.148584+0000","last_became_peered":"2024-09-17T03:13:34.148584+0000","last_unstale":"2024-09-17T03:13:39.157187+0000","last_undegraded":"2024-09-17T03:13:39.157187+0000","last_fullsized":"2024-09-17T03:13:39.157187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157720+0000","last_change":"2024-09-17T03:13:34.138509+0000","last_active":"2024-09-17T03:13:39.157720+0000","last_peered":"2024-09-17T03:13:39.157720+0000","last_clean":"2024-09-17T03:13:39.157720+0000","last_became_active":"2024-09-17T03:13:34.137862+0000","last_became_peered":"2024-09-17T03:13:34.137862+0000","last_unstale":"2024-09-17T03:13:39.157720+0000","last_undegraded":"2024-09-17T03:13:39.157720+0000","last_fullsized":"2024-09-17T03:13:39.157720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.125892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158457+0000","last_change":"2024-09-17T03:13:34.148276+0000","last_active":"2024-09-17T03:13:39.158457+0000","last_peered":"2024-09-17T03:13:39.158457+0000","last_clean":"2024-09-17T03:13:39.158457+0000","last_became_active":"2024-09-17T03:13:34.148053+0000","last_became_peered":"2024-09-17T03:13:34.148053+0000","last_unstale":"2024-09-17T03:13:39.158457+0000","last_undegraded":"2024-09-17T03:13:39.158457+0000","last_fullsized":"2024-09-17T03:13:39.158457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:23.791285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197786+0000","last_change":"2024-09-17T03:13:34.151106+0000","last_active":"2024-09-17T03:13:39.197786+0000","last_peered":"2024-09-17T03:13:39.197786+0000","last_clean":"2024-09-17T03:13:39.197786+0000","last_became_active":"2024-09-17T03:13:34.150584+0000","last_became_peered":"2024-09-17T03:13:34.150584+0000","last_unstale":"2024-09-17T03:13:39.197786+0000","last_undegraded":"2024-09-17T03:13:39.197786+0000","last_fullsized":"2024-09-17T03:13:39.197786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:11.890092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197394+0000","last_change":"2024-09-17T03:13:34.141641+0000","last_active":"2024-09-17T03:13:39.197394+0000","last_peered":"2024-09-17T03:13:39.197394+0000","last_clean":"2024-09-17T03:13:39.197394+0000","last_became_active":"2024-09-17T03:13:34.141338+0000","last_became_peered":"2024-09-17T03:13:34.141338+0000","last_unstale":"2024-09-17T03:13:39.197394+0000","last_undegraded":"2024-09-17T03:13:39.197394+0000","last_fullsized":"2024-09-17T03:13:39.197394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:35.475292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197098+0000","last_change":"2024-09-17T03:13:34.150804+0000","last_active":"2024-09-17T03:13:39.197098+0000","last_peered":"2024-09-17T03:13:39.197098+0000","last_clean":"2024-09-17T03:13:39.197098+0000","last_became_active":"2024-09-17T03:13:34.150486+0000","last_became_peered":"2024-09-17T03:13:34.150486+0000","last_unstale":"2024-09-17T03:13:39.197098+0000","last_undegraded":"2024-09-17T03:13:39.197098+0000","last_fullsized":"2024-09-17T03:13:39.197098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:18.029333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197517+0000","last_change":"2024-09-17T03:13:34.131477+0000","last_active":"2024-09-17T03:13:39.197517+0000","last_peered":"2024-09-17T03:13:39.197517+0000","last_clean":"2024-09-17T03:13:39.197517+0000","last_became_active":"2024-09-17T03:13:34.130564+0000","last_became_peered":"2024-09-17T03:13:34.130564+0000","last_unstale":"2024-09-17T03:13:39.197517+0000","last_undegraded":"2024-09-17T03:13:39.197517+0000","last_fullsized":"2024-09-17T03:13:39.197517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:34.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157103+0000","last_change":"2024-09-17T03:13:34.142799+0000","last_active":"2024-09-17T03:13:39.157103+0000","last_peered":"2024-09-17T03:13:39.157103+0000","last_clean":"2024-09-17T03:13:39.157103+0000","last_became_active":"2024-09-17T03:13:34.142494+0000","last_became_peered":"2024-09-17T03:13:34.142494+0000","last_unstale":"2024-09-17T03:13:39.157103+0000","last_undegraded":"2024-09-17T03:13:39.157103+0000","last_fullsized":"2024-09-17T03:13:39.157103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.778912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194970+0000","last_change":"2024-09-17T03:13:34.141400+0000","last_active":"2024-09-17T03:13:39.194970+0000","last_peered":"2024-09-17T03:13:39.194970+0000","last_clean":"2024-09-17T03:13:39.194970+0000","last_became_active":"2024-09-17T03:13:34.141088+0000","last_became_peered":"2024-09-17T03:13:34.141088+0000","last_unstale":"2024-09-17T03:13:39.194970+0000","last_undegraded":"2024-09-17T03:13:39.194970+0000","last_fullsized":"2024-09-17T03:13:39.194970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:34.516649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196351+0000","last_change":"2024-09-17T03:13:34.118085+0000","last_active":"2024-09-17T03:13:39.196351+0000","last_peered":"2024-09-17T03:13:39.196351+0000","last_clean":"2024-09-17T03:13:39.196351+0000","last_became_active":"2024-09-17T03:13:34.117665+0000","last_became_peered":"2024-09-17T03:13:34.117665+0000","last_unstale":"2024-09-17T03:13:39.196351+0000","last_undegraded":"2024-09-17T03:13:39.196351+0000","last_fullsized":"2024-09-17T03:13:39.196351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:31.700785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196520+0000","last_change":"2024-09-17T03:13:34.134663+0000","last_active":"2024-09-17T03:13:39.196520+0000","last_peered":"2024-09-17T03:13:39.196520+0000","last_clean":"2024-09-17T03:13:39.196520+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.196520+0000","last_undegraded":"2024-09-17T03:13:39.196520+0000","last_fullsized":"2024-09-17T03:13:39.196520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:54.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195773+0000","last_change":"2024-09-17T03:13:34.116909+0000","last_active":"2024-09-17T03:13:39.195773+0000","last_peered":"2024-09-17T03:13:39.195773+0000","last_clean":"2024-09-17T03:13:39.195773+0000","last_became_active":"2024-09-17T03:13:34.115590+0000","last_became_peered":"2024-09-17T03:13:34.115590+0000","last_unstale":"2024-09-17T03:13:39.195773+0000","last_undegraded":"2024-09-17T03:13:39.195773+0000","last_fullsized":"2024-09-17T03:13:39.195773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.277899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159836+0000","last_change":"2024-09-17T03:13:34.135845+0000","last_active":"2024-09-17T03:13:39.159836+0000","last_peered":"2024-09-17T03:13:39.159836+0000","last_clean":"2024-09-17T03:13:39.159836+0000","last_became_active":"2024-09-17T03:13:34.135526+0000","last_became_peered":"2024-09-17T03:13:34.135526+0000","last_unstale":"2024-09-17T03:13:39.159836+0000","last_undegraded":"2024-09-17T03:13:39.159836+0000","last_fullsized":"2024-09-17T03:13:39.159836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159196+0000","last_change":"2024-09-17T03:13:34.136523+0000","last_active":"2024-09-17T03:13:39.159196+0000","last_peered":"2024-09-17T03:13:39.159196+0000","last_clean":"2024-09-17T03:13:39.159196+0000","last_became_active":"2024-09-17T03:13:34.136202+0000","last_became_peered":"2024-09-17T03:13:34.136202+0000","last_unstale":"2024-09-17T03:13:39.159196+0000","last_undegraded":"2024-09-17T03:13:39.159196+0000","last_fullsized":"2024-09-17T03:13:39.159196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198096+0000","last_change":"2024-09-17T03:13:34.145425+0000","last_active":"2024-09-17T03:13:39.198096+0000","last_peered":"2024-09-17T03:13:39.198096+0000","last_clean":"2024-09-17T03:13:39.198096+0000","last_became_active":"2024-09-17T03:13:34.144888+0000","last_became_peered":"2024-09-17T03:13:34.144888+0000","last_unstale":"2024-09-17T03:13:39.198096+0000","last_undegraded":"2024-09-17T03:13:39.198096+0000","last_fullsized":"2024-09-17T03:13:39.198096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":112019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:53.128 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:13:53.129 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T03:13:53.129 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.391+0000 7f54da800640 1 -- 172.21.15.153:0/1689583396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b8005150 msgr2=0x7f54b800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.391+0000 7f54da800640 1 --2- 172.21.15.153:0/1689583396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b8005150 0x7f54b800b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f54cc005fd0 tx=0x7f54b8005830 comp rx=0 tx=0).stop 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.391+0000 7f54d3e00640 1 -- 172.21.15.153:0/1689583396 reap_dead start 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.392+0000 7f54da800640 1 -- 172.21.15.153:0/1689583396 shutdown_connections 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.392+0000 7f54da800640 1 -- 172.21.15.153:0/1689583396 >> 172.21.15.153:0/1689583396 conn(0x7f54d40b1b90 msgr2=0x7f54d40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.392+0000 7f54da800640 1 -- 172.21.15.153:0/1689583396 shutdown_connections 2024-09-17T03:13:53.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.392+0000 7f54da800640 1 -- 172.21.15.153:0/1689583396 wait complete. 2024-09-17T03:13:53.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.394+0000 7f54da800640 1 Processor -- start 2024-09-17T03:13:53.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.394+0000 7f54da800640 1 -- start start 2024-09-17T03:13:53.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54b8005150 0x7f54d415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40b21e0 0x7f54d40b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54d40cef00 con 0x7f54d40b55e0 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f54d406e710 con 0x7f54d40b21e0 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.395+0000 7f54da800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f54d40cf080 con 0x7f54b8005150 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57042/0 (socket says 172.21.15.153:57042) 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 -- 172.21.15.153:0/2143832661 learned_addr learned my addr 172.21.15.153:0/2143832661 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3400640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54b8005150 0x7f54d415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54caa00640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40b21e0 0x7f54d40b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 -- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54b8005150 msgr2=0x7f54d415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54b8005150 0x7f54d415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 -- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40b21e0 msgr2=0x7f54d40b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40b21e0 0x7f54d40b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.396+0000 7f54d3e00640 1 -- 172.21.15.153:0/2143832661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d40b59f0 con 0x7f54d40b55e0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54d3e00640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54cc005fd0 tx=0x7f54cc033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc043070 con 0x7f54d40b55e0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54cc033d20 con 0x7f54d40b55e0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc038040 con 0x7f54d40b55e0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d41f6a70 con 0x7f54d40b55e0 2024-09-17T03:13:53.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.397+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d4157280 con 0x7f54d40b55e0 2024-09-17T03:13:53.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.398+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d4074620 con 0x7f54d40b55e0 2024-09-17T03:13:53.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.399+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54cc003bd0 con 0x7f54d40b55e0 2024-09-17T03:13:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.400+0000 7f54cbe00640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 0x7f54b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.400+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f54cc0bb1e0 con 0x7f54d40b55e0 2024-09-17T03:13:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.401+0000 7f54d3400640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 0x7f54b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.401+0000 7f54d3400640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 0x7f54b007b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009cd0 tx=0x7f54c4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:53.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.405+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54d40b59f0 con 0x7f54d40b55e0 2024-09-17T03:13:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.587+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f54d40696c0 con 0x7f54d40b55e0 2024-09-17T03:13:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.588+0000 7f54cbe00640 1 -- 172.21.15.153:0/2143832661 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f54cc082bf0 con 0x7f54d40b55e0 2024-09-17T03:13:53.589 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 msgr2=0x7f54b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 0x7f54b007b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009cd0 tx=0x7f54c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 msgr2=0x7f54d41f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54cc005fd0 tx=0x7f54cc033c30 comp rx=0 tx=0).stop 2024-09-17T03:13:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 shutdown_connections 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f54b0078bc0 0x7f54b007b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54d40b55e0 0x7f54d41f29d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40b21e0 0x7f54d40b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 --2- 172.21.15.153:0/2143832661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f54b8005150 0x7f54d415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 >> 172.21.15.153:0/2143832661 conn(0x7f54d40b1b90 msgr2=0x7f54d40ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 shutdown_connections 2024-09-17T03:13:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.590+0000 7f54da800640 1 -- 172.21.15.153:0/2143832661 wait complete. 2024-09-17T03:13:53.610 INFO:teuthology.orchestra.run.smithi153.stdout:[{"version":31,"timestamp":"2024-09-17T03:13:21.109569+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"4708.762151"}]}] 2024-09-17T03:13:53.611 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T03:13:53.611 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T03:13:53.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T03:13:53.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T03:13:53.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 -- 172.21.15.153:0/4275639899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 msgr2=0x7f96dc154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 --2- 172.21.15.153:0/4275639899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc154ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009be0 tx=0x7f96d402a890 comp rx=0 tx=0).stop 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 -- 172.21.15.153:0/4275639899 shutdown_connections 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 --2- 172.21.15.153:0/4275639899 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc154ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 -- 172.21.15.153:0/4275639899 >> 172.21.15.153:0/4275639899 conn(0x7f96dc0d1930 msgr2=0x7f96dc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 -- 172.21.15.153:0/4275639899 shutdown_connections 2024-09-17T03:13:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.835+0000 7f96e3000640 1 -- 172.21.15.153:0/4275639899 wait complete. 2024-09-17T03:13:53.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.837+0000 7f96e3000640 1 Processor -- start 2024-09-17T03:13:53.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.837+0000 7f96e3000640 1 -- start start 2024-09-17T03:13:53.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96dc0b9e40 0x7f96dc1f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc155560 con 0x7f96dc158690 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc1553e0 con 0x7f96dc0b9e40 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e3000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc1556e0 con 0x7f96dc06d9c0 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e2600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e2600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56100/0 (socket says 172.21.15.153:56100) 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e2600640 1 -- 172.21.15.153:0/3116885778 learned_addr learned my addr 172.21.15.153:0/3116885778 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e1c00640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.839+0000 7f96e1200640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96dc0b9e40 0x7f96dc1f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 -- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 msgr2=0x7f96dc14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 -- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96dc0b9e40 msgr2=0x7f96dc1f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:53.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96dc0b9e40 0x7f96dc1f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:53.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 -- 172.21.15.153:0/3116885778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1514b0 con 0x7f96dc158690 2024-09-17T03:13:53.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e2600640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009be0 tx=0x7f96d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4041020 con 0x7f96dc158690 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d4004860 con 0x7f96dc158690 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc14f300 con 0x7f96dc158690 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4037040 con 0x7f96dc158690 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.840+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc14f020 con 0x7f96dc158690 2024-09-17T03:13:53.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.841+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc06ab30 con 0x7f96dc158690 2024-09-17T03:13:53.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.843+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96d4044020 con 0x7f96dc158690 2024-09-17T03:13:53.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.843+0000 7f96d9600640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 0x7f96bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:53.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.844+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f96d40bba50 con 0x7f96dc158690 2024-09-17T03:13:53.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.844+0000 7f96e1c00640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 0x7f96bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:53.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.845+0000 7f96e1c00640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 0x7f96bc07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96d0001a30 tx=0x7f96d0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:53.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:53.848+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96dc06ab30 con 0x7f96dc158690 2024-09-17T03:13:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.082+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f96dc154ea0 con 0x7f96dc158690 2024-09-17T03:13:54.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.085+0000 7f96d9600640 1 -- 172.21.15.153:0/3116885778 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194717 (secure 0 0 0) 0x7f96d404b030 con 0x7f96dc158690 2024-09-17T03:13:54.086 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:54.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 msgr2=0x7f96bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 0x7f96bc07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96d0001a30 tx=0x7f96d0009040 comp rx=0 tx=0).stop 2024-09-17T03:13:54.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 msgr2=0x7f96dc0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009be0 tx=0x7f96d4004360 comp rx=0 tx=0).stop 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 shutdown_connections 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f96bc078b90 0x7f96bc07b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96dc158690 0x7f96dc0cc640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96dc0b9e40 0x7f96dc1f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 --2- 172.21.15.153:0/3116885778 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96dc06d9c0 0x7f96dc14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 >> 172.21.15.153:0/3116885778 conn(0x7f96dc0d1930 msgr2=0x7f96dc160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.088+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 shutdown_connections 2024-09-17T03:13:54.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.089+0000 7f96e3000640 1 -- 172.21.15.153:0/3116885778 wait complete. 2024-09-17T03:13:54.112 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":5,"flags":0,"active_gid":4117,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":275265985},{"type":"v1","addr":"172.21.15.164:6801","nonce":275265985}]},"active_addr":"172.21.15.164:6801/275265985","active_change":"2024-09-17T03:13:10.804491+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":77858473}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3463406871}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3035883842}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":1643873374}]}]} 2024-09-17T03:13:54.118 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T03:13:54.118 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T03:13:54.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 -- 172.21.15.153:0/540932674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e4074cb0 msgr2=0x7f60e4073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 --2- 172.21.15.153:0/540932674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e4074cb0 0x7f60e4073dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f60e4076390 tx=0x7f60d802a560 comp rx=0 tx=0).stop 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 -- 172.21.15.153:0/540932674 shutdown_connections 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 --2- 172.21.15.153:0/540932674 >> v2:172.21.15.164:3300/0 conn(0x7f60e406ddf0 0x7f60e406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 --2- 172.21.15.153:0/540932674 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e40cbc10 0x7f60e40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 --2- 172.21.15.153:0/540932674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e4074cb0 0x7f60e4073dd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 -- 172.21.15.153:0/540932674 >> 172.21.15.153:0/540932674 conn(0x7f60e40cca40 msgr2=0x7f60e40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 -- 172.21.15.153:0/540932674 shutdown_connections 2024-09-17T03:13:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.342+0000 7f60eb600640 1 -- 172.21.15.153:0/540932674 wait complete. 2024-09-17T03:13:54.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.345+0000 7f60eb600640 1 Processor -- start 2024-09-17T03:13:54.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.345+0000 7f60eb600640 1 -- start start 2024-09-17T03:13:54.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e4074cb0 0x7f60e41f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60e40cbc10 0x7f60e41f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60e406f170 con 0x7f60e406ddf0 2024-09-17T03:13:54.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f60e406eff0 con 0x7f60e40cbc10 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.346+0000 7f60eb600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f60e406f2f0 con 0x7f60e4074cb0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56126/0 (socket says 172.21.15.153:56126) 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 -- 172.21.15.153:0/4106805271 learned_addr learned my addr 172.21.15.153:0/4106805271 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e3e00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e4074cb0 0x7f60e41f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e9600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60e40cbc10 0x7f60e41f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 -- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e4074cb0 msgr2=0x7f60e41f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e4074cb0 0x7f60e41f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 -- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60e40cbc10 msgr2=0x7f60e41f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60e40cbc10 0x7f60e41f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 -- 172.21.15.153:0/4106805271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e40b4a10 con 0x7f60e406ddf0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.347+0000 7f60e8c00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60d8034040 tx=0x7f60d80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:54.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.348+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d803e030 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.348+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d8003ca0 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.348+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8035040 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.348+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e40b4cf0 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.348+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e40b52b0 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.349+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e4072860 con 0x7f60e406ddf0 2024-09-17T03:13:54.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.350+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60d8041030 con 0x7f60e406ddf0 2024-09-17T03:13:54.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.351+0000 7f60e0c00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 0x7f60c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.351+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f60d80bba60 con 0x7f60e406ddf0 2024-09-17T03:13:54.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.352+0000 7f60e3e00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 0x7f60c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.352+0000 7f60e3e00640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 0x7f60c407b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b5d30 tx=0x7f60d000b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:54.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.355+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60e4072860 con 0x7f60e406ddf0 2024-09-17T03:13:54.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.539+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60e4073dd0 con 0x7f60e406ddf0 2024-09-17T03:13:54.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.541+0000 7f60e0c00640 1 -- 172.21.15.153:0/4106805271 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f60d8083470 con 0x7f60e406ddf0 2024-09-17T03:13:54.540 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:54.540 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 msgr2=0x7f60c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 0x7f60c407b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f60e40b5d30 tx=0x7f60d000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 msgr2=0x7f60e40b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60d8034040 tx=0x7f60d80038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 shutdown_connections 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f60c4078b90 0x7f60c407b0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60e40cbc10 0x7f60e41f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60e4074cb0 0x7f60e41f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 --2- 172.21.15.153:0/4106805271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60e406ddf0 0x7f60e40b4270 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 >> 172.21.15.153:0/4106805271 conn(0x7f60e40cca40 msgr2=0x7f60e4070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 shutdown_connections 2024-09-17T03:13:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.543+0000 7f60eb600640 1 -- 172.21.15.153:0/4106805271 wait complete. 2024-09-17T03:13:54.564 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T03:13:54.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 -- 172.21.15.153:0/4139295071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc06e500 msgr2=0x7f1fcc0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/4139295071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc06e500 0x7f1fcc0cc020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4005fd0 tx=0x7f1fc402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 -- 172.21.15.153:0/4139295071 shutdown_connections 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/4139295071 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc06e500 0x7f1fcc0cc020 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/4139295071 >> v2:172.21.15.164:3300/0 conn(0x7f1fcc074cb0 0x7f1fcc073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 -- 172.21.15.153:0/4139295071 >> 172.21.15.153:0/4139295071 conn(0x7f1fcc0cca40 msgr2=0x7f1fcc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 -- 172.21.15.153:0/4139295071 shutdown_connections 2024-09-17T03:13:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.791+0000 7f1fd0a00640 1 -- 172.21.15.153:0/4139295071 wait complete. 2024-09-17T03:13:54.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.793+0000 7f1fd0a00640 1 Processor -- start 2024-09-17T03:13:54.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.795+0000 7f1fd0a00640 1 -- start start 2024-09-17T03:13:54.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc0cbc10 0x7f1fcc1f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fcc1f6ec0 0x7f1fcc0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc06f3f0 con 0x7f1fcc074cb0 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc06f270 con 0x7f1fcc1f6ec0 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1fcc06f570 con 0x7f1fcc0cbc10 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fc9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.796+0000 7f1fc9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56132/0 (socket says 172.21.15.153:56132) 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 -- 172.21.15.153:0/2321662165 learned_addr learned my addr 172.21.15.153:0/2321662165 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9400640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc0cbc10 0x7f1fcc1f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fca800640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fcc1f6ec0 0x7f1fcc0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 -- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc0cbc10 msgr2=0x7f1fcc1f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc0cbc10 0x7f1fcc1f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 -- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fcc1f6ec0 msgr2=0x7f1fcc0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fcc1f6ec0 0x7f1fcc0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 -- 172.21.15.153:0/2321662165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc0b5450 con 0x7f1fcc074cb0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc9e00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009fd0 tx=0x7f1fbc00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.797+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00ccc0 con 0x7f1fcc074cb0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.798+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc0b5730 con 0x7f1fcc074cb0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.798+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fbc00ee70 con 0x7f1fcc074cb0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.798+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00ce60 con 0x7f1fcc074cb0 2024-09-17T03:13:54.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.798+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc0b2f40 con 0x7f1fcc074cb0 2024-09-17T03:13:54.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.799+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fcc0b5c50 con 0x7f1fcc074cb0 2024-09-17T03:13:54.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.800+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fbc004280 con 0x7f1fcc074cb0 2024-09-17T03:13:54.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.801+0000 7f1fc2000640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 0x7f1fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:54.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.801+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1fbc09b8f0 con 0x7f1fcc074cb0 2024-09-17T03:13:54.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.802+0000 7f1fc9400640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 0x7f1fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:54.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.802+0000 7f1fc9400640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 0x7f1fac07b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007fd0 tx=0x7f1fb8001390 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:54.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.806+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fcc0b5c50 con 0x7f1fcc074cb0 2024-09-17T03:13:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.991+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fcc06fa90 con 0x7f1fcc074cb0 2024-09-17T03:13:54.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.993+0000 7f1fc2000640 1 -- 172.21.15.153:0/2321662165 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f1fbc0633b0 con 0x7f1fcc074cb0 2024-09-17T03:13:54.992 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:54.992 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 msgr2=0x7f1fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 0x7f1fac07b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007fd0 tx=0x7f1fb8001390 comp rx=0 tx=0).stop 2024-09-17T03:13:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 msgr2=0x7f1fcc157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009fd0 tx=0x7f1fbc00ec20 comp rx=0 tx=0).stop 2024-09-17T03:13:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 shutdown_connections 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1fac078b90 0x7f1fac07b0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fcc1f6ec0 0x7f1fcc0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fcc0cbc10 0x7f1fcc1f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 --2- 172.21.15.153:0/2321662165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc074cb0 0x7f1fcc157310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 >> 172.21.15.153:0/2321662165 conn(0x7f1fcc0cca40 msgr2=0x7f1fcc06e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 shutdown_connections 2024-09-17T03:13:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:54.995+0000 7f1fd0a00640 1 -- 172.21.15.153:0/2321662165 wait complete. 2024-09-17T03:13:55.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T03:13:55.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T03:13:55.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T03:13:55.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T03:13:55.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T03:13:55.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T03:13:55.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T03:13:55.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T03:13:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.413+0000 7fbcdd600640 1 -- 172.21.15.153:0/1547144298 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00aea00 con 0x7fbcd8053860 2024-09-17T03:13:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.414+0000 7fbce5a00640 1 -- 172.21.15.153:0/1547144298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8053860 msgr2=0x7fbcd803c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.414+0000 7fbce5a00640 1 --2- 172.21.15.153:0/1547144298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8053860 0x7fbcd803c450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbce0000b60 tx=0x7fbce00a63c0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.415+0000 7fbce5a00640 1 -- 172.21.15.153:0/1547144298 shutdown_connections 2024-09-17T03:13:55.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.415+0000 7fbce5a00640 1 --2- 172.21.15.153:0/1547144298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8053860 0x7fbcd803c450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.415+0000 7fbce5a00640 1 --2- 172.21.15.153:0/1547144298 >> v2:172.21.15.164:3300/0 conn(0x7fbcd8054190 0x7fbcd8007550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.415+0000 7fbce5a00640 1 -- 172.21.15.153:0/1547144298 >> 172.21.15.153:0/1547144298 conn(0x7fbcd803a680 msgr2=0x7fbcd803aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.417+0000 7fbce5a00640 1 -- 172.21.15.153:0/1547144298 shutdown_connections 2024-09-17T03:13:55.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.417+0000 7fbce5a00640 1 -- 172.21.15.153:0/1547144298 wait complete. 2024-09-17T03:13:55.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.420+0000 7f1745c00640 1 -- 172.21.15.153:0/75267732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f174015f6d0 msgr2=0x7f174015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.420+0000 7f1745c00640 1 --2- 172.21.15.153:0/75267732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f174015f6d0 0x7f174015e3d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1730009830 tx=0x7f173002a480 comp rx=0 tx=0).stop 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 -- 172.21.15.153:0/75267732 shutdown_connections 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 --2- 172.21.15.153:0/75267732 >> v2:172.21.15.164:3300/0 conn(0x7f17400d2290 0x7f17400d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 --2- 172.21.15.153:0/75267732 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f174015f6d0 0x7f174015e3d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 -- 172.21.15.153:0/75267732 >> 172.21.15.153:0/75267732 conn(0x7f17400d41e0 msgr2=0x7f17400d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7fbce5a00640 1 Processor -- start 2024-09-17T03:13:55.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 -- 172.21.15.153:0/75267732 shutdown_connections 2024-09-17T03:13:55.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.421+0000 7f1745c00640 1 -- 172.21.15.153:0/75267732 wait complete. 2024-09-17T03:13:55.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7fbce5a00640 1 -- start start 2024-09-17T03:13:55.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 -- 172.21.15.153:0/2047884642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f571803c1f0 msgr2=0x7f5718053eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 --2- 172.21.15.153:0/2047884642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f571803c1f0 0x7f5718053eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f570c005fd0 tx=0x7f570c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 -- 172.21.15.153:0/2047884642 shutdown_connections 2024-09-17T03:13:55.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 --2- 172.21.15.153:0/2047884642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5718056da0 0x7f57180e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 --2- 172.21.15.153:0/2047884642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f571803c1f0 0x7f5718053eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.422+0000 7f571f200640 1 -- 172.21.15.153:0/2047884642 >> 172.21.15.153:0/2047884642 conn(0x7f571803a5f0 msgr2=0x7f571803aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.423+0000 7f571f200640 1 -- 172.21.15.153:0/2047884642 shutdown_connections 2024-09-17T03:13:55.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.423+0000 7f571f200640 1 -- 172.21.15.153:0/2047884642 wait complete. 2024-09-17T03:13:55.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.424+0000 7f1745c00640 1 Processor -- start 2024-09-17T03:13:55.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.425+0000 7f1745c00640 1 -- start start 2024-09-17T03:13:55.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.425+0000 7fbce5a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 0x7fbcd8039c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.425+0000 7fbce5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8054190 0x7fbcd80e4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbcdea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 0x7fbcd8039c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbcdea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 0x7fbcd8039c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56304/0 (socket says 172.21.15.153:56304) 2024-09-17T03:13:55.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbcdea00640 1 -- 172.21.15.153:0/4234946425 learned_addr learned my addr 172.21.15.153:0/4234946425 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbcde000640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8054190 0x7fbcd80e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbce5a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcd80e3200 0x7fbcd80e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd803cb10 con 0x7fbcd8054190 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17400cef00 0x7f17401581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17400d2290 0x7f174015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f174015f6d0 0x7f174015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17400d2d60 con 0x7f174015f6d0 2024-09-17T03:13:55.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f17400d2be0 con 0x7f17400cef00 2024-09-17T03:13:55.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.426+0000 7f1745c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f17400d2ee0 con 0x7f17400d2290 2024-09-17T03:13:55.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f6cb4400640 1 -- 172.21.15.153:0/3437670769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cf6b0 msgr2=0x7f6cac15f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f6cb4400640 1 --2- 172.21.15.153:0/3437670769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cf6b0 0x7f6cac15f5b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0005fd0 tx=0x7f6ca002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd803c990 con 0x7fbcd80e3200 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd803cc90 con 0x7fbcd8053860 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdf400640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcd80e3200 0x7fbcd80e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdea00640 1 -- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcd80e3200 msgr2=0x7fbcd80e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdea00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcd80e3200 0x7fbcd80e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdea00640 1 -- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8054190 msgr2=0x7fbcd80e4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdea00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8054190 0x7fbcd80e4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7fbcdea00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd80e4750 con 0x7fbcd8053860 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f173fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17400cef00 0x7f17401581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f173f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17400d2290 0x7f174015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f173f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17400d2290 0x7f174015a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56316/0 (socket says 172.21.15.153:56316) 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f173f400640 1 -- 172.21.15.153:0/285924766 learned_addr learned my addr 172.21.15.153:0/285924766 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.427+0000 7f1745200640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f174015f6d0 0x7f174015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f6cb4400640 1 -- 172.21.15.153:0/3437670769 shutdown_connections 2024-09-17T03:13:55.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f6cb4400640 1 --2- 172.21.15.153:0/3437670769 >> v2:172.21.15.153:3300/0 conn(0x7f6cac0cfac0 0x7f6cac162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f571f200640 1 Processor -- start 2024-09-17T03:13:55.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f6cb4400640 1 --2- 172.21.15.153:0/3437670769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cf6b0 0x7f6cac15f5b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f6cb4400640 1 -- 172.21.15.153:0/3437670769 >> 172.21.15.153:0/3437670769 conn(0x7f6cac0b1b90 msgr2=0x7f6cac0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7fbcdea00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 0x7fbcd8039c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c970 tx=0x7fbcd000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f571f200640 1 -- start start 2024-09-17T03:13:55.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f1745200640 1 -- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17400d2290 msgr2=0x7f174015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f1745200640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17400d2290 0x7f174015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f1745200640 1 -- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17400cef00 msgr2=0x7f17401581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f1745200640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17400cef00 0x7f17401581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7f1745200640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17400cdc60 con 0x7f174015f6d0 2024-09-17T03:13:55.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.428+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007bb0 con 0x7fbcd8053860 2024-09-17T03:13:55.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7f6cb4400640 1 -- 172.21.15.153:0/3437670769 shutdown_connections 2024-09-17T03:13:55.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd0007e40 con 0x7fbcd8053860 2024-09-17T03:13:55.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd000f690 con 0x7fbcd8053860 2024-09-17T03:13:55.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd8052ae0 con 0x7fbcd8053860 2024-09-17T03:13:55.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd8052520 con 0x7fbcd8053860 2024-09-17T03:13:55.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7f1745200640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f174015f6d0 0x7f174015aa20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f173800e9b0 tx=0x7f173800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.429+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173800cd80 con 0x7f174015f6d0 2024-09-17T03:13:55.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1738004c10 con 0x7f174015f6d0 2024-09-17T03:13:55.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173800cd80 con 0x7f174015f6d0 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 -- 172.21.15.153:0/3408180186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c0cf4f0 msgr2=0x7fc13c0b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 --2- 172.21.15.153:0/3408180186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c0b3410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc13c15eb60 tx=0x7fc13402a7f0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 -- 172.21.15.153:0/3408180186 shutdown_connections 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 --2- 172.21.15.153:0/3408180186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c0b3410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 --2- 172.21.15.153:0/3408180186 >> v2:172.21.15.153:3300/0 conn(0x7fc13c070d30 0x7fc13c0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fc143400640 1 -- 172.21.15.153:0/3408180186 >> 172.21.15.153:0/3408180186 conn(0x7fc13c0cfec0 msgr2=0x7fc13c0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.431+0000 7f571f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f571803c1f0 0x7f57180518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcb8001030 con 0x7fbcd8053860 2024-09-17T03:13:55.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.431+0000 7f571f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57180537b0 0x7f57180d1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5718056da0 0x7f57180d1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17401f9a20 con 0x7f174015f6d0 2024-09-17T03:13:55.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17401fb580 con 0x7f174015f6d0 2024-09-17T03:13:55.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.431+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17400d3420 con 0x7f174015f6d0 2024-09-17T03:13:55.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5718006920 con 0x7f5718056da0 2024-09-17T03:13:55.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f57180e78b0 con 0x7f57180537b0 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5718006aa0 con 0x7f571803c1f0 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f571803c1f0 0x7f57180518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.432+0000 7f571de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f571803c1f0 0x7f57180518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56326/0 (socket says 172.21.15.153:56326) 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.433+0000 7f571de00640 1 -- 172.21.15.153:0/3060189394 learned_addr learned my addr 172.21.15.153:0/3060189394 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.433+0000 7f571e800640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5718056da0 0x7f57180d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.433+0000 7fc143400640 1 -- 172.21.15.153:0/3408180186 shutdown_connections 2024-09-17T03:13:55.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.433+0000 7f571e800640 1 -- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f571803c1f0 msgr2=0x7f57180518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7f571e800640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f571803c1f0 0x7f57180518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7f571e800640 1 -- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57180537b0 msgr2=0x7f57180d1300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:13:55.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7f571e800640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57180537b0 0x7f57180d1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7f571e800640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571817f350 con 0x7f5718056da0 2024-09-17T03:13:55.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcd0018400 con 0x7fbcd8053860 2024-09-17T03:13:55.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.430+0000 7f6cb4400640 1 -- 172.21.15.153:0/3437670769 wait complete. 2024-09-17T03:13:55.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1738018470 con 0x7f174015f6d0 2024-09-17T03:13:55.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.434+0000 7fc143400640 1 -- 172.21.15.153:0/3408180186 wait complete. 2024-09-17T03:13:55.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.435+0000 7f6cb4400640 1 Processor -- start 2024-09-17T03:13:55.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.435+0000 7f6cb4400640 1 -- start start 2024-09-17T03:13:55.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7fbcd6a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcc0078c60 0x7fbcc007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbcd009be40 con 0x7fbcd8053860 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7fbcd6a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fbcc0082420 0x7fbcc00848b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcd0020e50 con 0x7fbcc0082420 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcd009c230 con 0x7fbcd8053860 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7fbcdf400640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fbcc0082420 0x7fbcc00848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.435+0000 7f571e800640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5718056da0 0x7f57180d1840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f572006bcf0 tx=0x7f572006af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720075c50 con 0x7f5718056da0 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f572008f070 con 0x7f5718056da0 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200764f0 con 0x7f5718056da0 2024-09-17T03:13:55.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.436+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571817e590 con 0x7f5718056da0 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cac073000 0x7f6cac1f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 0x7f6cac09d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.437+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cfac0 0x7f6cac09fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f6cb4400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac162d20 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f6cb4400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac162ba0 con 0x7f6cac073000 2024-09-17T03:13:55.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f6cb4400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac06ddf0 con 0x7f6cac0cfac0 2024-09-17T03:13:55.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7fc143400640 1 Processor -- start 2024-09-17T03:13:55.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7fbcde000640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcc0078c60 0x7fbcc007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f1737e00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1720078d90 0x7f172007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f173809bf70 con 0x7f174015f6d0 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f1737e00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f17200824e0 0x7f1720084970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f173801fe80 con 0x7f17200824e0 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f173809c400 con 0x7f174015f6d0 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7f173f400640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f17200824e0 0x7f1720084970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.438+0000 7fc143400640 1 -- start start 2024-09-17T03:13:55.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571817eb50 con 0x7f5718056da0 2024-09-17T03:13:55.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 0x7f6cac09d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7f6cb1a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cac073000 0x7f6cac1f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.440+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 0x7f6cac09d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56200/0 (socket says 172.21.15.153:56200) 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.440+0000 7f6cb1000640 1 -- 172.21.15.153:0/1549313660 learned_addr learned my addr 172.21.15.153:0/1549313660 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.440+0000 7f6cb2400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cfac0 0x7f6cac09fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7f173fe00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1720078d90 0x7f172007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.440+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5718053eb0 con 0x7f5718056da0 2024-09-17T03:13:55.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.440+0000 7f173f400640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f17200824e0 0x7f1720084970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.439+0000 7fbcde000640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcc0078c60 0x7fbcc007b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbcd803a520 tx=0x7fbccc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.441+0000 7f173fe00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1720078d90 0x7f172007b2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1730034000 tx=0x7f1730004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.441+0000 7fbcdf400640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fbcc0082420 0x7fbcc00848b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.441+0000 7f6635200640 1 -- 172.21.15.153:0/3309670152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f663015ead0 msgr2=0x7f6630162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.441+0000 7f6635200640 1 --2- 172.21.15.153:0/3309670152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f663015ead0 0x7f6630162e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66300b6ff0 tx=0x7f662002a9e0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 -- 172.21.15.153:0/3309670152 shutdown_connections 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 --2- 172.21.15.153:0/3309670152 >> v2:172.21.15.164:3300/0 conn(0x7f66300cd450 0x7f66300cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 --2- 172.21.15.153:0/3309670152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f663015ead0 0x7f6630162e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 -- 172.21.15.153:0/3309670152 >> 172.21.15.153:0/3309670152 conn(0x7f66300b46e0 msgr2=0x7f66300d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 -- 172.21.15.153:0/3309670152 shutdown_connections 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f6635200640 1 -- 172.21.15.153:0/3309670152 wait complete. 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5720074050 con 0x7f5718056da0 2024-09-17T03:13:55.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== osd.0 v2:172.21.15.153:6824/86413606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcd0020e50 con 0x7fbcc0082420 2024-09-17T03:13:55.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7fc143400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 0x7fc13c140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7f6cb1000640 1 -- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cfac0 msgr2=0x7f6cac09fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.442+0000 7fc143400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc143400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c1f0c50 0x7fc13c140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc143400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c06cf60 con 0x7fc13c0cf4f0 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc143400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c06cde0 con 0x7fc13c1f0c50 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc143400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c06d0e0 con 0x7fc13c070d30 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc140a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 0x7fc13c140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc140a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 0x7fc13c140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56358/0 (socket says 172.21.15.153:56358) 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc140a00640 1 -- 172.21.15.153:0/3117229535 learned_addr learned my addr 172.21.15.153:0/3117229535 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7fc141400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c1f0c50 0x7fc13c140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== osd.2 v2:172.21.15.153:6800/1315287280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f173801fe80 con 0x7f17200824e0 2024-09-17T03:13:55.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7ff103e00640 1 -- 172.21.15.153:0/4151155992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc0b9ad0 msgr2=0x7ff0fc0d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7ff103e00640 1 --2- 172.21.15.153:0/4151155992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc0b9ad0 0x7ff0fc0d0be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0d06b0 tx=0x7ff0e802a440 comp rx=0 tx=0).stop 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 -- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c1f0c50 msgr2=0x7fc13c140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc13c1f0c50 0x7fc13c140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 -- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc13c0cf4f0 msgr2=0x7fc13c14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc13be00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c14f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c1f1540 con 0x7fc13c070d30 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc140a00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 0x7fc13c140c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c430 tx=0x7fc13000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130017070 con 0x7fc13c070d30 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.443+0000 7f6cb1000640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cfac0 0x7f6cac09fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7f6cb1000640 1 -- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cac073000 msgr2=0x7f6cac1f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7f6cb1000640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cac073000 0x7f6cac1f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7f6cb1000640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac2067e0 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.444+0000 7f6cb1a00640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cac073000 0x7f6cac1f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:55.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7f5716000640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5700078be0 0x7f570007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1300053e0 con 0x7fc13c070d30 2024-09-17T03:13:55.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300118b0 con 0x7fc13c070d30 2024-09-17T03:13:55.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7f6cb2400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cac0cfac0 0x7f6cac09fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:55.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 -- 172.21.15.153:0/4151155992 shutdown_connections 2024-09-17T03:13:55.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 --2- 172.21.15.153:0/4151155992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc0b9ad0 0x7ff0fc0d0be0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 --2- 172.21.15.153:0/4151155992 >> v2:172.21.15.153:3300/0 conn(0x7ff0fc15ee80 0x7ff0fc0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 -- 172.21.15.153:0/4151155992 >> 172.21.15.153:0/4151155992 conn(0x7ff0fc09d830 msgr2=0x7ff0fc0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 -- 172.21.15.153:0/4151155992 shutdown_connections 2024-09-17T03:13:55.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c1f1820 con 0x7fc13c070d30 2024-09-17T03:13:55.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7fc13be00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc13c0cf4f0 0x7fc13c14f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f57201163b0 con 0x7f5718056da0 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7f571de00640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5700078be0 0x7f570007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7f5716000640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7f57000823b0 0x7f5700084840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.446+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5720097e50 con 0x7f57000823b0 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.446+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f572011b060 con 0x7f5718056da0 2024-09-17T03:13:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c1f1060 con 0x7fc13c070d30 2024-09-17T03:13:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.446+0000 7f571d400640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7f57000823b0 0x7f5700084840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.446+0000 7f6635200640 1 Processor -- start 2024-09-17T03:13:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.445+0000 7ff103e00640 1 -- 172.21.15.153:0/4151155992 wait complete. 2024-09-17T03:13:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.447+0000 7f6cb1000640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 0x7f6cac09d700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0034040 tx=0x7f6ca0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.447+0000 7f6635200640 1 -- start start 2024-09-17T03:13:55.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.447+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc13c06ac80 con 0x7fc13c070d30 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.447+0000 7f571d400640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7f57000823b0 0x7f5700084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7f571de00640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5700078be0 0x7f570007b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f570c009230 tx=0x7f570c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca003e030 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ca0003c90 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0035040 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1f91e0 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7fcd38c00640 1 -- 172.21.15.153:0/2025791207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd340cf6b0 msgr2=0x7fcd3415f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7fcd38c00640 1 --2- 172.21.15.153:0/2025791207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd340cf6b0 0x7fcd3415f5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009830 tx=0x7fcd1c02a530 comp rx=0 tx=0).stop 2024-09-17T03:13:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.448+0000 7fcd38c00640 1 -- 172.21.15.153:0/2025791207 shutdown_connections 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fcd38c00640 1 --2- 172.21.15.153:0/2025791207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd340cf6b0 0x7fcd3415f5b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fcd38c00640 1 --2- 172.21.15.153:0/2025791207 >> v2:172.21.15.164:3300/0 conn(0x7fcd34073000 0x7fcd340cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fcd38c00640 1 -- 172.21.15.153:0/2025791207 >> 172.21.15.153:0/2025791207 conn(0x7fcd340b1b90 msgr2=0x7fcd340b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fcd38c00640 1 -- 172.21.15.153:0/2025791207 shutdown_connections 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc13001a070 con 0x7fc13c070d30 2024-09-17T03:13:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7fcd38c00640 1 -- 172.21.15.153:0/2025791207 wait complete. 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 0x7f6630152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 0x7f6630158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f663015ead0 0x7f66301585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66300cdf20 con 0x7f66300b5bd0 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f66300cdda0 con 0x7f66300cd450 2024-09-17T03:13:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.449+0000 7f6635200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f66300ce0a0 con 0x7f663015ead0 2024-09-17T03:13:55.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac205eb0 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 0x7f6630152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 0x7f6630158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 0x7f6630152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56208/0 (socket says 172.21.15.153:56208) 2024-09-17T03:13:55.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 0x7f6630158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57046/0 (socket says 172.21.15.153:57046) 2024-09-17T03:13:55.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662de00640 1 -- 172.21.15.153:0/1926686972 learned_addr learned my addr 172.21.15.153:0/1926686972 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7fc138c00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc11c078bc0 0x7fc11c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.450+0000 7f662e800640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f663015ead0 0x7f66301585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662de00640 1 -- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f663015ead0 msgr2=0x7f66301585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662de00640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f663015ead0 0x7f66301585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662de00640 1 -- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 msgr2=0x7f6630158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662de00640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 0x7f6630158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662de00640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6630153770 con 0x7f66300b5bd0 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc13009a310 con 0x7fc13c070d30 2024-09-17T03:13:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7fc138c00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fc11c082390 0x7fc11c084820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc13000ae50 con 0x7fc11c082390 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1300a1050 con 0x7fc13c070d30 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.453+0000 7fc13be00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc11c078bc0 0x7fc11c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7ff103e00640 1 Processor -- start 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7ff103e00640 1 -- start start 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662e800640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f663015ead0 0x7f66301585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.451+0000 7f662d400640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66300cd450 0x7f6630158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7f662de00640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 0x7f6630152cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c430 tx=0x7f661c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c017070 con 0x7f66300b5bd0 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f661c0053c0 con 0x7f66300b5bd0 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66301f8e50 con 0x7f66300b5bd0 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6630153230 con 0x7f66300b5bd0 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.453+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c003850 con 0x7f66300b5bd0 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.452+0000 7fcd38c00640 1 Processor -- start 2024-09-17T03:13:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.453+0000 7fcd38c00640 1 -- start start 2024-09-17T03:13:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.453+0000 7fc141400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fc11c082390 0x7fc11c084820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== osd.1 v2:172.21.15.153:6816/987187311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5720097e50 con 0x7f57000823b0 2024-09-17T03:13:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66301f9510 con 0x7f66300b5bd0 2024-09-17T03:13:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fc13be00640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc11c078bc0 0x7fc11c07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc13c15d780 tx=0x7fc128009260 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd34073000 0x7fcd3409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd340cf6b0 0x7fcd341f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 0x7fcd340b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3415fe80 con 0x7fcd340cf6b0 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3415fd00 con 0x7fcd340cfac0 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fcd38c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3409d800 con 0x7fcd34073000 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.455+0000 7fcd31e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd34073000 0x7fcd3409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.455+0000 7ff103e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 0x7ff0fc157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.455+0000 7fcd32800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 0x7fcd340b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.455+0000 7fcd32800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 0x7fcd340b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57052/0 (socket says 172.21.15.153:57052) 2024-09-17T03:13:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.455+0000 7fcd32800640 1 -- 172.21.15.153:0/1006122980 learned_addr learned my addr 172.21.15.153:0/1006122980 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff103e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0fc0d1120 0x7ff0fc06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ca0041030 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff101400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 0x7ff0fc157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd29400640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd340cf6b0 0x7fcd341f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff101400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 0x7ff0fc157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56398/0 (socket says 172.21.15.153:56398) 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff101400640 1 -- 172.21.15.153:0/3853834395 learned_addr learned my addr 172.21.15.153:0/3853834395 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd32800640 1 -- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd34073000 msgr2=0x7fcd3409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd32800640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd34073000 0x7fcd3409adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd32800640 1 -- 172.21.15.153:0/1006122980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd340cf6b0 msgr2=0x7fcd341f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd32800640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd340cf6b0 0x7fcd341f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd32800640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd341f60f0 con 0x7fcd340cfac0 2024-09-17T03:13:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7fcd29400640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd340cf6b0 0x7fcd341f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cac15f5b0 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff103e00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc15ee80 0x7ff0fc0d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc0b6700 con 0x7ff0fc0d1120 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc0b6580 con 0x7ff0fc15ee80 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff0fc0b6880 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.456+0000 7ff100a00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0fc0d1120 0x7ff0fc06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7fcd32800640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 0x7fcd340b50a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00cae0 tx=0x7fcd2c00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101e00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc15ee80 0x7ff0fc0d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f661c01a070 con 0x7f66300b5bd0 2024-09-17T03:13:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c016020 con 0x7fcd340cfac0 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd2c00ad30 con 0x7fcd340cfac0 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c012680 con 0x7fcd340cfac0 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101400640 1 -- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc15ee80 msgr2=0x7ff0fc0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101400640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc15ee80 0x7ff0fc0d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101400640 1 -- 172.21.15.153:0/3853834395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0fc0d1120 msgr2=0x7ff0fc06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101400640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0fc0d1120 0x7ff0fc06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101400640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc06fc40 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.457+0000 7ff101e00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0fc15ee80 0x7ff0fc0d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.454+0000 7fc141400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fc11c082390 0x7fc11c084820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.458+0000 7ff101400640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 0x7ff0fc157530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000b440 tx=0x7ff0f000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.458+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== osd.3 v2:172.21.15.153:6808/4242955698 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc13000ae50 con 0x7fc11c082390 2024-09-17T03:13:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.458+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0015020 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.458+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc1f9390 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.458+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc1f9950 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7f6ca9600640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c8c078be0 0x7f6c8c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0f0011980 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0011dd0 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6ca00bf020 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6cb1a00640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c8c078be0 0x7f6c8c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7f6626000640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6610078b90 0x7f661007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.459+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f661c09a360 con 0x7f66300b5bd0 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6626000640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7f6610082360 0x7f66100847f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f661c016ec0 con 0x7f6610082360 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f661c0a1050 con 0x7f66300b5bd0 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f662d400640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6610078b90 0x7f661007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f662e800640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7f6610082360 0x7f66100847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6ca9600640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f6c8c0823a0 0x7f6c8c084830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.461+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0fc1f9140 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ca0032e50 con 0x7f6c8c0823a0 2024-09-17T03:13:55.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ca00bab40 con 0x7f6cac0cf6b0 2024-09-17T03:13:55.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.460+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd34150c10 con 0x7fcd340cfac0 2024-09-17T03:13:55.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.461+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd341511d0 con 0x7fcd340cfac0 2024-09-17T03:13:55.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.461+0000 7f6cb2400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f6c8c0823a0 0x7f6c8c084830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.462+0000 7f6cb1a00640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c8c078be0 0x7f6c8c07b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.462+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0f0018020 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.462+0000 7f662d400640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6610078b90 0x7f661007b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6620035000 tx=0x7f6620004ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.462+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd34150a30 con 0x7fcd340cfac0 2024-09-17T03:13:55.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7ff0f9600640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff0dc078b90 0x7ff0dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff0f009b150 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7ff0f9600640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7ff0dc0822e0 0x7ff0dc084770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0f0018ec0 con 0x7ff0dc0822e0 2024-09-17T03:13:55.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff0f00a2050 con 0x7ff0fc0b9ad0 2024-09-17T03:13:55.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.464+0000 7f662e800640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7f6610082360 0x7f66100847f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.465+0000 7f6cb2400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f6c8c0823a0 0x7f6c8c084830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.465+0000 7ff101e00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7ff0dc0822e0 0x7ff0dc084770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.465+0000 7ff100a00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff0dc078b90 0x7ff0dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.466+0000 7ff101e00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7ff0dc0822e0 0x7ff0dc084770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.466+0000 7ff100a00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff0dc078b90 0x7ff0dc07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8034000 tx=0x7ff0e8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.466+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== osd.6 v2:172.21.15.164:6802/3366340382 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f661c016ec0 con 0x7f6610082360 2024-09-17T03:13:55.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.466+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== osd.4 v2:172.21.15.164:6810/4054245927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ca0032e50 con 0x7f6c8c0823a0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.469+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== osd.5 v2:172.21.15.164:6826/2605220404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0f0018ec0 con 0x7ff0dc0822e0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.469+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd2c019020 con 0x7fcd340cfac0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.471+0000 7fcd2aa00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd10078b90 0x7fcd1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.471+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcd2c09bcb0 con 0x7fcd340cfac0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.472+0000 7fcd2aa00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fcd100822d0 0x7fcd10084760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.472+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd10084e30 con 0x7fcd100822d0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.472+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcd2c09c060 con 0x7fcd340cfac0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.472+0000 7fcd31e00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd10078b90 0x7fcd1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.472+0000 7fcd29400640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fcd100822d0 0x7fcd10084760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.473+0000 7fcd29400640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fcd100822d0 0x7fcd10084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.474+0000 7fcd31e00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd10078b90 0x7fcd1007b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd240099f0 tx=0x7fcd24005f30 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.474+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== osd.7 v2:172.21.15.164:6818/1373012278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd10084e30 con 0x7fcd100822d0 2024-09-17T03:13:55.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.480+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 --> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbcb8002dd0 con 0x7fbcc0082420 2024-09-17T03:13:55.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.481+0000 7fbcd6a00640 1 -- 172.21.15.153:0/4234946425 <== osd.0 v2:172.21.15.153:6824/86413606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbcb8002dd0 con 0x7fbcc0082420 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.482+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fbcc0082420 msgr2=0x7fbcc00848b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.482+0000 7fbce5a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fbcc0082420 0x7fbcc00848b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.483+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcc0078c60 msgr2=0x7fbcc007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.483+0000 7fbce5a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcc0078c60 0x7fbcc007b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbcd803a520 tx=0x7fbccc009040 comp rx=0 tx=0).stop 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.483+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 msgr2=0x7fbcd8039c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.483+0000 7fbce5a00640 1 --2- 172.21.15.153:0/4234946425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcd8053860 0x7fbcd8039c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c970 tx=0x7fbcd000ce30 comp rx=0 tx=0).stop 2024-09-17T03:13:55.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.483+0000 7fbcdf400640 1 -- 172.21.15.153:0/4234946425 reap_dead start 2024-09-17T03:13:55.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.484+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 --> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17401fb820 con 0x7f17200824e0 2024-09-17T03:13:55.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.484+0000 7f1737e00640 1 -- 172.21.15.153:0/285924766 <== osd.2 v2:172.21.15.153:6800/1315287280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f17401fb820 con 0x7f17200824e0 2024-09-17T03:13:55.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f17200824e0 msgr2=0x7f1720084970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f17200824e0 0x7f1720084970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 shutdown_connections 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 >> 172.21.15.153:0/4234946425 conn(0x7fbcd803a680 msgr2=0x7fbcd803e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1720078d90 msgr2=0x7f172007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1720078d90 0x7f172007b2a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1730034000 tx=0x7f1730004730 comp rx=0 tx=0).stop 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f174015f6d0 msgr2=0x7f174015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 --2- 172.21.15.153:0/285924766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f174015f6d0 0x7f174015aa20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f173800e9b0 tx=0x7f173800ee70 comp rx=0 tx=0).stop 2024-09-17T03:13:55.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 shutdown_connections 2024-09-17T03:13:55.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745200640 1 -- 172.21.15.153:0/285924766 reap_dead start 2024-09-17T03:13:55.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 --> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cac205930 con 0x7f6c8c0823a0 2024-09-17T03:13:55.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7fbce5a00640 1 -- 172.21.15.153:0/4234946425 wait complete. 2024-09-17T03:13:55.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 shutdown_connections 2024-09-17T03:13:55.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 >> 172.21.15.153:0/285924766 conn(0x7f17400d41e0 msgr2=0x7f17400b9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.485+0000 7f6ca9600640 1 -- 172.21.15.153:0/1549313660 <== osd.4 v2:172.21.15.164:6810/4054245927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6cac205930 con 0x7f6c8c0823a0 2024-09-17T03:13:55.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.486+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 shutdown_connections 2024-09-17T03:13:55.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.486+0000 7f1745c00640 1 -- 172.21.15.153:0/285924766 wait complete. 2024-09-17T03:13:55.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.487+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 --> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57180d97f0 con 0x7f57000823b0 2024-09-17T03:13:55.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.488+0000 7f5716000640 1 -- 172.21.15.153:0/3060189394 <== osd.1 v2:172.21.15.153:6816/987187311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57180d97f0 con 0x7f57000823b0 2024-09-17T03:13:55.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.488+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 --> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc13c0cde30 con 0x7fc11c082390 2024-09-17T03:13:55.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.488+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f6c8c0823a0 msgr2=0x7f6c8c084830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.488+0000 7f6cb4400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f6c8c0823a0 0x7f6c8c084830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7f57000823b0 msgr2=0x7f5700084840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f571f200640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7f57000823b0 0x7f5700084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7fc138c00640 1 -- 172.21.15.153:0/3117229535 <== osd.3 v2:172.21.15.153:6808/4242955698 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc13c0cde30 con 0x7fc11c082390 2024-09-17T03:13:55.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5700078be0 msgr2=0x7f570007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f571f200640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5700078be0 0x7f570007b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f570c009230 tx=0x7f570c004730 comp rx=0 tx=0).stop 2024-09-17T03:13:55.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5718056da0 msgr2=0x7f57180d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 --2- 172.21.15.153:0/3060189394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5718056da0 0x7f57180d1840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f572006bcf0 tx=0x7f572006af00 comp rx=0 tx=0).stop 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571e800640 1 -- 172.21.15.153:0/3060189394 reap_dead start 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 shutdown_connections 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 >> 172.21.15.153:0/3060189394 conn(0x7f571803a5f0 msgr2=0x7f57180dadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 shutdown_connections 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fc11c082390 msgr2=0x7fc11c084820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7fc143400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fc11c082390 0x7fc11c084820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.490+0000 7f571f200640 1 -- 172.21.15.153:0/3060189394 wait complete. 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c8c078be0 msgr2=0x7f6c8c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c8c078be0 0x7f6c8c07b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).stop 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 msgr2=0x7f6cac09d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 --2- 172.21.15.153:0/1549313660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cac0cf6b0 0x7f6cac09d700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0034040 tx=0x7f6ca0003820 comp rx=0 tx=0).stop 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb2400640 1 -- 172.21.15.153:0/1549313660 reap_dead start 2024-09-17T03:13:55.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 shutdown_connections 2024-09-17T03:13:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.489+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 >> 172.21.15.153:0/1549313660 conn(0x7f6cac0b1b90 msgr2=0x7f6cac0b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc11c078bc0 msgr2=0x7fc11c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc11c078bc0 0x7fc11c07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc13c15d780 tx=0x7fc128009260 comp rx=0 tx=0).stop 2024-09-17T03:13:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 msgr2=0x7fc13c140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 --2- 172.21.15.153:0/3117229535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc13c070d30 0x7fc13c140c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c430 tx=0x7fc13000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc141400640 1 -- 172.21.15.153:0/3117229535 reap_dead start 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 shutdown_connections 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 >> 172.21.15.153:0/3117229535 conn(0x7fc13c0cfec0 msgr2=0x7fc13c15a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 shutdown_connections 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.491+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 shutdown_connections 2024-09-17T03:13:55.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.492+0000 7fc143400640 1 -- 172.21.15.153:0/3117229535 wait complete. 2024-09-17T03:13:55.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.492+0000 7f6cb4400640 1 -- 172.21.15.153:0/1549313660 wait complete. 2024-09-17T03:13:55.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.497+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 --> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66301f8c40 con 0x7f6610082360 2024-09-17T03:13:55.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.501+0000 7ff103e00640 1 -- 172.21.15.153:0/3853834395 --> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0fc1f9f10 con 0x7ff0dc0822e0 2024-09-17T03:13:55.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.502+0000 7f6626000640 1 -- 172.21.15.153:0/1926686972 <== osd.6 v2:172.21.15.164:6802/3366340382 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f66301f8c40 con 0x7f6610082360 2024-09-17T03:13:55.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.502+0000 7ff0f9600640 1 -- 172.21.15.153:0/3853834395 <== osd.5 v2:172.21.15.164:6826/2605220404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0fc1f9f10 con 0x7ff0dc0822e0 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7f6610082360 msgr2=0x7f66100847f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7f6610082360 0x7f66100847f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6610078b90 msgr2=0x7f661007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7ff0dc0822e0 msgr2=0x7ff0dc084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6610078b90 0x7f661007b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6620035000 tx=0x7f6620004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 msgr2=0x7f6630152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7f6635200640 1 --2- 172.21.15.153:0/1926686972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300b5bd0 0x7f6630152cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c430 tx=0x7f661c00c8f0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.503+0000 7ff0eea00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7ff0dc0822e0 0x7ff0dc084770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7f662e800640 1 -- 172.21.15.153:0/1926686972 reap_dead start 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff0dc078b90 msgr2=0x7ff0dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff0dc078b90 0x7ff0dc07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8034000 tx=0x7ff0e8004730 comp rx=0 tx=0).stop 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 msgr2=0x7ff0fc157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 --2- 172.21.15.153:0/3853834395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0fc0b9ad0 0x7ff0fc157530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000b440 tx=0x7ff0f000b900 comp rx=0 tx=0).stop 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff101e00640 1 -- 172.21.15.153:0/3853834395 reap_dead start 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 shutdown_connections 2024-09-17T03:13:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.504+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 >> 172.21.15.153:0/3853834395 conn(0x7ff0fc09d830 msgr2=0x7ff0fc0b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.505+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 shutdown_connections 2024-09-17T03:13:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.505+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 --> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd341f5ea0 con 0x7fcd100822d0 2024-09-17T03:13:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 shutdown_connections 2024-09-17T03:13:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 >> 172.21.15.153:0/1926686972 conn(0x7f66300b46e0 msgr2=0x7f663015de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7ff0eea00640 1 -- 172.21.15.153:0/3853834395 wait complete. 2024-09-17T03:13:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 shutdown_connections 2024-09-17T03:13:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7f6635200640 1 -- 172.21.15.153:0/1926686972 wait complete. 2024-09-17T03:13:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.506+0000 7fcd2aa00640 1 -- 172.21.15.153:0/1006122980 <== osd.7 v2:172.21.15.164:6818/1373012278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd341f5ea0 con 0x7fcd100822d0 2024-09-17T03:13:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.507+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fcd100822d0 msgr2=0x7fcd10084760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.507+0000 7fcd38c00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fcd100822d0 0x7fcd10084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.507+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd10078b90 msgr2=0x7fcd1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.507+0000 7fcd38c00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd10078b90 0x7fcd1007b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd240099f0 tx=0x7fcd24005f30 comp rx=0 tx=0).stop 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.508+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 msgr2=0x7fcd340b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.508+0000 7fcd38c00640 1 --2- 172.21.15.153:0/1006122980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd340cfac0 0x7fcd340b50a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00cae0 tx=0x7fcd2c00a060 comp rx=0 tx=0).stop 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.508+0000 7fcd32800640 1 -- 172.21.15.153:0/1006122980 reap_dead start 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.514+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 shutdown_connections 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.514+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 >> 172.21.15.153:0/1006122980 conn(0x7fcd340b1b90 msgr2=0x7fcd340b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.514+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 shutdown_connections 2024-09-17T03:13:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.514+0000 7fcd38c00640 1 -- 172.21.15.153:0/1006122980 wait complete. 2024-09-17T03:13:55.525 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:55.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:13:55.533 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:55.533 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:55.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:13:55.534 INFO:teuthology.orchestra.run.smithi153.stdout:64424509450 2024-09-17T03:13:55.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:13:55.535 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:55.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:13:55.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:13:55.538 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:55.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:13:55.540 INFO:teuthology.orchestra.run.smithi153.stdout:55834574859 2024-09-17T03:13:55.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:13:55.541 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:55.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:13:55.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.907+0000 7f12a9c00640 1 -- 172.21.15.153:0/1092225450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a415ef90 msgr2=0x7f12a415f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.907+0000 7f12a9c00640 1 --2- 172.21.15.153:0/1092225450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a415ef90 0x7f12a415f3a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12a40cff30 tx=0x7f129c02a940 comp rx=0 tx=0).stop 2024-09-17T03:13:55.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.908+0000 7f12a9c00640 1 -- 172.21.15.153:0/1092225450 shutdown_connections 2024-09-17T03:13:55.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.908+0000 7f12a9c00640 1 --2- 172.21.15.153:0/1092225450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a415ef90 0x7f12a415f3a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.908+0000 7f12a9c00640 1 --2- 172.21.15.153:0/1092225450 >> v2:172.21.15.164:3300/0 conn(0x7f12a4073ba0 0x7f12a40b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.908+0000 7f12a9c00640 1 -- 172.21.15.153:0/1092225450 >> 172.21.15.153:0/1092225450 conn(0x7f12a40d0590 msgr2=0x7f12a406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.908+0000 7f12a9c00640 1 -- 172.21.15.153:0/1092225450 shutdown_connections 2024-09-17T03:13:55.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.909+0000 7f12a9c00640 1 -- 172.21.15.153:0/1092225450 wait complete. 2024-09-17T03:13:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.914+0000 7f12a9c00640 1 Processor -- start 2024-09-17T03:13:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.914+0000 7f12a9c00640 1 -- start start 2024-09-17T03:13:55.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.920+0000 7f12a9c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.920+0000 7f12a9c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f12a2a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f12a2a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56460/0 (socket says 172.21.15.153:56460) 2024-09-17T03:13:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f83c9a00640 1 -- 172.21.15.153:0/3246798664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83a8003a70 msgr2=0x7f83a8003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f12a2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f12a2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56286/0 (socket says 172.21.15.153:56286) 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3246798664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83a8003a70 0x7f83a8003ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83bc005fd0 tx=0x7f83a8005830 comp rx=0 tx=0).stop 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f83c9000640 1 -- 172.21.15.153:0/3246798664 reap_dead start 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.921+0000 7f83c9a00640 1 -- 172.21.15.153:0/3246798664 shutdown_connections 2024-09-17T03:13:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f83c9a00640 1 -- 172.21.15.153:0/3246798664 >> 172.21.15.153:0/3246798664 conn(0x7f83c40d05c0 msgr2=0x7f83c406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f12a2a00640 1 -- 172.21.15.153:0/598801214 learned_addr learned my addr 172.21.15.153:0/598801214 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f83c9a00640 1 -- 172.21.15.153:0/3246798664 shutdown_connections 2024-09-17T03:13:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 0x7f12a4133840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.922+0000 7f83c9a00640 1 -- 172.21.15.153:0/3246798664 wait complete. 2024-09-17T03:13:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.923+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40cec70 con 0x7f12a4073ba0 2024-09-17T03:13:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.923+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40ceaf0 con 0x7f12a415ef90 2024-09-17T03:13:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.923+0000 7f12a3400640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 0x7f12a4133840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.924+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f12a40cedf0 con 0x7f12a406ef40 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.924+0000 7f2047e00640 1 -- 172.21.15.153:0/1451487571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f204815f6d0 msgr2=0x7f204815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.924+0000 7f2047e00640 1 --2- 172.21.15.153:0/1451487571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f204815f6d0 0x7f204815e3d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20480b6dd0 tx=0x7f203802aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 -- 172.21.15.153:0/1451487571 shutdown_connections 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 --2- 172.21.15.153:0/1451487571 >> v2:172.21.15.153:3300/0 conn(0x7f2048162240 0x7f2048162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 --2- 172.21.15.153:0/1451487571 >> v2:172.21.15.164:3300/0 conn(0x7f20480cef00 0x7f20480cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 --2- 172.21.15.153:0/1451487571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f204815f6d0 0x7f204815e3d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 -- 172.21.15.153:0/1451487571 >> 172.21.15.153:0/1451487571 conn(0x7f20480d41e0 msgr2=0x7f20480d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 -- 172.21.15.153:0/1451487571 shutdown_connections 2024-09-17T03:13:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f2047e00640 1 -- 172.21.15.153:0/1451487571 wait complete. 2024-09-17T03:13:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.925+0000 7f12a3400640 1 -- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 msgr2=0x7f12a414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a3400640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a3400640 1 -- 172.21.15.153:0/598801214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 msgr2=0x7f12a4133300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a3400640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a3400640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a414ec20 con 0x7f12a415ef90 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a2a00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.926+0000 7f12a2000640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f8700e00640 1 -- 172.21.15.153:0/1285408507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e00037a0 msgr2=0x7f86e0003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f8700e00640 1 --2- 172.21.15.153:0/1285408507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e00037a0 0x7f86e0003bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86ec004060 tx=0x7f86e0005830 comp rx=0 tx=0).stop 2024-09-17T03:13:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f83c9a00640 1 Processor -- start 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f83c9a00640 1 -- start start 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f8700e00640 1 -- 172.21.15.153:0/1285408507 shutdown_connections 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f8700e00640 1 --2- 172.21.15.153:0/1285408507 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86e00037a0 0x7f86e0003bb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f8700e00640 1 -- 172.21.15.153:0/1285408507 >> 172.21.15.153:0/1285408507 conn(0x7f86f4051410 msgr2=0x7f86f4051850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f12a3400640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 0x7f12a4133840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12a4070e70 tx=0x7f129c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f65eb400640 1 -- 172.21.15.153:0/861348138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e40cfac0 msgr2=0x7f65e4162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.927+0000 7f65eb400640 1 --2- 172.21.15.153:0/861348138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e40cfac0 0x7f65e4162450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65e40b26b0 tx=0x7f65d402a490 comp rx=0 tx=0).stop 2024-09-17T03:13:55.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f8700e00640 1 -- 172.21.15.153:0/1285408507 shutdown_connections 2024-09-17T03:13:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c030430 con 0x7f12a415ef90 2024-09-17T03:13:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f129c042070 con 0x7f12a415ef90 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c03a6a0 con 0x7f12a415ef90 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a414bcc0 con 0x7f12a415ef90 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a414e140 con 0x7f12a415ef90 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.930+0000 7f2047e00640 1 Processor -- start 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.930+0000 7f2047e00640 1 -- start start 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 -- 172.21.15.153:0/861348138 shutdown_connections 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 --2- 172.21.15.153:0/861348138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e40cfac0 0x7f65e4162450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 --2- 172.21.15.153:0/861348138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e415f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 --2- 172.21.15.153:0/861348138 >> v2:172.21.15.164:3300/0 conn(0x7f65e4073000 0x7f65e40cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 -- 172.21.15.153:0/861348138 >> 172.21.15.153:0/861348138 conn(0x7f65e40b1b90 msgr2=0x7f65e40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 -- 172.21.15.153:0/861348138 shutdown_connections 2024-09-17T03:13:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f8700e00640 1 -- 172.21.15.153:0/1285408507 wait complete. 2024-09-17T03:13:55.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.928+0000 7f65eb400640 1 -- 172.21.15.153:0/861348138 wait complete. 2024-09-17T03:13:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 0x7f83c413bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 0x7f83c4152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4070de0 con 0x7f83c413c280 2024-09-17T03:13:55.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f83c4070c60 con 0x7f83a8003a70 2024-09-17T03:13:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f83c9000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 0x7f83c4152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f83c3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57136/0 (socket says 172.21.15.153:57136) 2024-09-17T03:13:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f83c3e00640 1 -- 172.21.15.153:0/3273706272 learned_addr learned my addr 172.21.15.153:0/3273706272 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.932+0000 7f8700e00640 1 Processor -- start 2024-09-17T03:13:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f83c415e5d0 con 0x7f83c413b930 2024-09-17T03:13:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f83c3400640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 0x7f83c413bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f65eb400640 1 Processor -- start 2024-09-17T03:13:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a41542e0 con 0x7f12a415ef90 2024-09-17T03:13:55.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f2047e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 0x7f204814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f65eb400640 1 -- start start 2024-09-17T03:13:55.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f2047e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2047e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2048162240 0x7f204814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3400640 1 -- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 msgr2=0x7f83c414e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3400640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3400640 1 -- 172.21.15.153:0/3273706272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 msgr2=0x7f83c4152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2047e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f204806dc50 con 0x7f20480cef00 2024-09-17T03:13:55.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2047e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f204806dad0 con 0x7f204815f6d0 2024-09-17T03:13:55.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2047e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2048162b90 con 0x7f2048162240 2024-09-17T03:13:55.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3400640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 0x7f83c4152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3400640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4154090 con 0x7f83c413b930 2024-09-17T03:13:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2046000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2046000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57138/0 (socket says 172.21.15.153:57138) 2024-09-17T03:13:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f2046000640 1 -- 172.21.15.153:0/2510551530 learned_addr learned my addr 172.21.15.153:0/2510551530 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.933+0000 7f8700e00640 1 -- start start 2024-09-17T03:13:55.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046a00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 0x7f204814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c3e00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:55.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.934+0000 7f83c9000640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 0x7f83c4152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046000640 1 -- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2048162240 msgr2=0x7f204814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046000640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2048162240 0x7f204814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046000640 1 -- 172.21.15.153:0/2510551530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 msgr2=0x7f204814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046000640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 0x7f204814cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.935+0000 7f2046000640 1 -- 172.21.15.153:0/2510551530 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204814d910 con 0x7f204815f6d0 2024-09-17T03:13:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f2046a00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 0x7f204814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:55.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f129c03a840 con 0x7f12a415ef90 2024-09-17T03:13:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f83c3400640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 0x7f83c413bd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c940 tx=0x7f83b000ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f2046000640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2030009fd0 tx=0x7f203000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0004220 con 0x7f83c413b930 2024-09-17T03:13:55.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c4154370 con 0x7f83c413b930 2024-09-17T03:13:55.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c413b410 con 0x7f83c413b930 2024-09-17T03:13:55.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f129aa00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 0x7f128407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f129c0bbea0 con 0x7f12a415ef90 2024-09-17T03:13:55.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83b00079b0 con 0x7f83c413b930 2024-09-17T03:13:55.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0007e00 con 0x7f83c413b930 2024-09-17T03:13:55.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86f40de3d0 0x7f86f4034910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f12a2a00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 0x7f128407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86f4034e50 0x7f86f404a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86f400a6d0 con 0x7f86e00037a0 2024-09-17T03:13:55.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86f400a080 con 0x7f86f40de3d0 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f8700e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f86f400a850 con 0x7f86f4034e50 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.936+0000 7f86f9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56316/0 (socket says 172.21.15.153:56316) 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 -- 172.21.15.153:0/913938643 learned_addr learned my addr 172.21.15.153:0/913938643 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9400640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86f40de3d0 0x7f86f4034910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 -- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86f4034e50 msgr2=0x7f86f404a2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86f4034e50 0x7f86f404a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 -- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86f40de3d0 msgr2=0x7f86f4034910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86f40de3d0 0x7f86f4034910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.937+0000 7f86f9e00640 1 -- 172.21.15.153:0/913938643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f40dce40 con 0x7f86e00037a0 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f86f9e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86fc000b60 tx=0x7f86fc06af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc064810 con 0x7f86e00037a0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86fc076380 con 0x7f86e00037a0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f40dd120 con 0x7f86e00037a0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.938+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc064810 con 0x7f86e00037a0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.939+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f40dd6e0 con 0x7f86e00037a0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 0x7f65e415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65e40cfac0 0x7f65e409af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65e4162990 con 0x7f65e4073000 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f65e415fe10 con 0x7f65e40cfac0 2024-09-17T03:13:55.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65eb400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f65e4162b10 con 0x7f65e40cf6b0 2024-09-17T03:13:55.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000ccc0 con 0x7f204815f6d0 2024-09-17T03:13:55.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f203000ee70 con 0x7f204815f6d0 2024-09-17T03:13:55.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000ce60 con 0x7f204815f6d0 2024-09-17T03:13:55.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.941+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f129c04b060 con 0x7f12a415ef90 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56502/0 (socket says 172.21.15.153:56502) 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65e9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65e40cfac0 0x7f65e409af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.940+0000 7f65e3e00640 1 -- 172.21.15.153:0/1861527780 learned_addr learned my addr 172.21.15.153:0/1861527780 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.941+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204814dbb0 con 0x7f204815f6d0 2024-09-17T03:13:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.941+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204814e170 con 0x7f204815f6d0 2024-09-17T03:13:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.942+0000 7f86e7400640 1 -- 172.21.15.153:0/913938643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d0005290 con 0x7f86e00037a0 2024-09-17T03:13:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.941+0000 7f65e8a00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 0x7f65e415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e3e00640 1 -- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65e40cfac0 msgr2=0x7f65e409af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e3e00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65e40cfac0 0x7f65e409af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e3e00640 1 -- 172.21.15.153:0/1861527780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 msgr2=0x7f65e415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e3e00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 0x7f65e415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e3e00640 1 -- 172.21.15.153:0/1861527780 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40b3f50 con 0x7f65e40cf6b0 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f65e8a00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 0x7f65e415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.944+0000 7f65e3e00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65d000e9f0 tx=0x7f65d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.944+0000 7f12a2a00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 0x7f128407b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.943+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86fc076570 con 0x7f86e00037a0 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.945+0000 7f86f2000640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 0x7f86dc07b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.945+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f86fc116f60 con 0x7f86e00037a0 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.946+0000 7f86f9400640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 0x7f86dc07b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.944+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c005290 con 0x7f83c413b930 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.947+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d000cd80 con 0x7f65e40cf6b0 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.947+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65d0004020 con 0x7f65e40cf6b0 2024-09-17T03:13:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.947+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0004470 con 0x7f65e40cf6b0 2024-09-17T03:13:55.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.946+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83b00035f0 con 0x7f83c413b930 2024-09-17T03:13:55.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.947+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204815e3d0 con 0x7f204815f6d0 2024-09-17T03:13:55.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.948+0000 7f83bbe00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 0x7f83a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.948+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f83b009b560 con 0x7f83c413b930 2024-09-17T03:13:55.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.948+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2030005260 con 0x7f204815f6d0 2024-09-17T03:13:55.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.947+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e4202460 con 0x7f65e40cf6b0 2024-09-17T03:13:55.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.949+0000 7f83c3e00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 0x7f83a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.949+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e4202a20 con 0x7f65e40cf6b0 2024-09-17T03:13:55.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.949+0000 7f203f400640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 0x7f202407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.950+0000 7f86f9400640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 0x7f86dc07b2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86ec001c30 tx=0x7f86ec02d000 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.950+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f203009ba90 con 0x7f204815f6d0 2024-09-17T03:13:55.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.951+0000 7f2046a00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 0x7f202407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.951+0000 7f83c3e00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 0x7f83a407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83bc036040 tx=0x7f83bc00e040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.951+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e42063b0 con 0x7f65e40cf6b0 2024-09-17T03:13:55.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.952+0000 7f2046a00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 0x7f202407b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2038035000 tx=0x7f2038004ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.953+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86fc0df170 con 0x7f86e00037a0 2024-09-17T03:13:55.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.953+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83b0014030 con 0x7f83c413b930 2024-09-17T03:13:55.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.957+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2030063b70 con 0x7f204815f6d0 2024-09-17T03:13:55.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.956+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65d00035f0 con 0x7f65e40cf6b0 2024-09-17T03:13:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.957+0000 7f65e0c00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 0x7f65c407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.958+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f65d0009400 con 0x7f65e40cf6b0 2024-09-17T03:13:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.962+0000 7f65e8a00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 0x7f65c407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.962+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65d0063c70 con 0x7f65e40cf6b0 2024-09-17T03:13:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.963+0000 7f65e8a00640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 0x7f65c407b0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65dc005fd0 tx=0x7f65dc0094a0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.991+0000 7f39dda00640 1 -- 172.21.15.153:0/4284738208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d8074880 msgr2=0x7f39d806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.991+0000 7f39dda00640 1 --2- 172.21.15.153:0/4284738208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d8074880 0x7f39d806edf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39d806e630 tx=0x7f39c802a560 comp rx=0 tx=0).stop 2024-09-17T03:13:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.992+0000 7f39dda00640 1 -- 172.21.15.153:0/4284738208 shutdown_connections 2024-09-17T03:13:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.992+0000 7f39dda00640 1 --2- 172.21.15.153:0/4284738208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d8074880 0x7f39d806edf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.992+0000 7f39dda00640 1 --2- 172.21.15.153:0/4284738208 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d80b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.992+0000 7f39dda00640 1 -- 172.21.15.153:0/4284738208 >> 172.21.15.153:0/4284738208 conn(0x7f39d80d0350 msgr2=0x7f39d80d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.992+0000 7f39dda00640 1 -- 172.21.15.153:0/4284738208 shutdown_connections 2024-09-17T03:13:55.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.993+0000 7f39dda00640 1 -- 172.21.15.153:0/4284738208 wait complete. 2024-09-17T03:13:55.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 -- 172.21.15.153:0/874851764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 msgr2=0x7fa8c006f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:55.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/874851764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c006f620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00af3f0 tx=0x7fa8b802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 -- 172.21.15.153:0/874851764 shutdown_connections 2024-09-17T03:13:55.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/874851764 >> v2:172.21.15.153:3300/0 conn(0x7fa8c01557d0 0x7fa8c0162770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/874851764 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c006f620 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:55.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.996+0000 7fa8c4e00640 1 -- 172.21.15.153:0/874851764 >> 172.21.15.153:0/874851764 conn(0x7fa8c006cde0 msgr2=0x7fa8c006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:55.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.997+0000 7f39dda00640 1 Processor -- start 2024-09-17T03:13:55.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.998+0000 7fa8c4e00640 1 -- 172.21.15.153:0/874851764 shutdown_connections 2024-09-17T03:13:55.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.998+0000 7fa8c4e00640 1 -- 172.21.15.153:0/874851764 wait complete. 2024-09-17T03:13:55.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.997+0000 7f39dda00640 1 -- start start 2024-09-17T03:13:55.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.999+0000 7f39dda00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d806f330 0x7f39d8159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.999+0000 7f39dda00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:55.999+0000 7f39dda00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39dda00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39d806f950 con 0x7f39d8074880 2024-09-17T03:13:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39dda00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8162a50 con 0x7f39d806f330 2024-09-17T03:13:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39dda00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f39d8157570 con 0x7f39d80af4e0 2024-09-17T03:13:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39d6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39d6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56348/0 (socket says 172.21.15.153:56348) 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39d7400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.000+0000 7f39d6000640 1 -- 172.21.15.153:0/2431739014 learned_addr learned my addr 172.21.15.153:0/2431739014 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d7400640 1 -- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d806f330 msgr2=0x7f39d8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d7400640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d806f330 0x7f39d8159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d7400640 1 -- 172.21.15.153:0/2431739014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 msgr2=0x7f39d80ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d7400640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d7400640 1 -- 172.21.15.153:0/2431739014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d81fd3a0 con 0x7f39d80af4e0 2024-09-17T03:13:56.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.001+0000 7f39d6000640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:56.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.002+0000 7f39d7400640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d8152070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39d000bdf0 tx=0x7f39d0009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.002+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0019070 con 0x7f39d80af4e0 2024-09-17T03:13:56.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.002+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39d0014440 con 0x7f39d80af4e0 2024-09-17T03:13:56.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.002+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0014890 con 0x7f39d80af4e0 2024-09-17T03:13:56.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.002+0000 7f39dda00640 1 -- 172.21.15.153:0/2431739014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d81fd680 con 0x7f39d80af4e0 2024-09-17T03:13:56.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.003+0000 7f39dda00640 1 -- 172.21.15.153:0/2431739014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d80aa630 con 0x7f39d80af4e0 2024-09-17T03:13:56.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.005+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a8005290 con 0x7f39d80af4e0 2024-09-17T03:13:56.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.006+0000 7fa8c4e00640 1 Processor -- start 2024-09-17T03:13:56.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.007+0000 7fa8c4e00640 1 -- start start 2024-09-17T03:13:56.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8c01557d0 0x7fa8c00ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0162360 0x7fa8c0153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c00ceff0 con 0x7fa8c0162360 2024-09-17T03:13:56.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c00cee70 con 0x7fa8c0073990 2024-09-17T03:13:56.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7fa8c4e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c00cf170 con 0x7fa8c01557d0 2024-09-17T03:13:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.010+0000 7fa8bf400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.010+0000 7fa8bf400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57178/0 (socket says 172.21.15.153:57178) 2024-09-17T03:13:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.010+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8c01557d0 0x7fa8c00ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.010+0000 7fa8bf400640 1 -- 172.21.15.153:0/3695552902 learned_addr learned my addr 172.21.15.153:0/3695552902 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.009+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39d001c070 con 0x7f39d80af4e0 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.011+0000 7f39cea00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 0x7f39b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.011+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39d009b070 con 0x7f39d80af4e0 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7f39d6a00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 0x7f39b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bfe00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0162360 0x7fa8c0153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bf400640 1 -- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8c01557d0 msgr2=0x7fa8c00ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bf400640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8c01557d0 0x7fa8c00ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bf400640 1 -- 172.21.15.153:0/3695552902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0162360 msgr2=0x7fa8c0153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bf400640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0162360 0x7fa8c0153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.012+0000 7fa8bf400640 1 -- 172.21.15.153:0/3695552902 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c01fd500 con 0x7fa8c0073990 2024-09-17T03:13:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.013+0000 7f39d6a00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 0x7f39b407b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39c00058c0 tx=0x7f39c0005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.013+0000 7fa8bf400640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009b30 tx=0x7fa8b8003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.014+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8031990 con 0x7fa8c0073990 2024-09-17T03:13:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.014+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8b8031c20 con 0x7fa8c0073990 2024-09-17T03:13:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.014+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8033330 con 0x7fa8c0073990 2024-09-17T03:13:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.015+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c01fd7e0 con 0x7fa8c0073990 2024-09-17T03:13:56.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.015+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c01563c0 con 0x7fa8c0073990 2024-09-17T03:13:56.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.018+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39d0062a80 con 0x7f39d80af4e0 2024-09-17T03:13:56.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.017+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c0156610 con 0x7fa8c0073990 2024-09-17T03:13:56.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8b80334d0 con 0x7fa8c0073990 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7f926ac00640 1 -- 172.21.15.153:0/1975422313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c004cb0 msgr2=0x7f924c005100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7f926ac00640 1 --2- 172.21.15.153:0/1975422313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c004cb0 0x7f924c005100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d20 tx=0x7f924c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7f926ac00640 1 -- 172.21.15.153:0/1975422313 shutdown_connections 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7f926ac00640 1 --2- 172.21.15.153:0/1975422313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f924c004cb0 0x7f924c005100 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d20 tx=0x7f924c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.021+0000 7f926ac00640 1 -- 172.21.15.153:0/1975422313 >> 172.21.15.153:0/1975422313 conn(0x7f92640d41e0 msgr2=0x7f92640d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.023+0000 7f926ac00640 1 -- 172.21.15.153:0/1975422313 shutdown_connections 2024-09-17T03:13:56.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.023+0000 7fa8b7400640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 0x7fa8a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.023+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa8b80bc520 con 0x7fa8c0073990 2024-09-17T03:13:56.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.023+0000 7f926ac00640 1 -- 172.21.15.153:0/1975422313 wait complete. 2024-09-17T03:13:56.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.024+0000 7fa8bea00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 0x7fa8a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.025+0000 7fa8bea00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 0x7fa8a007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0162900 tx=0x7fa8ac009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.026+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8b803f030 con 0x7fa8c0073990 2024-09-17T03:13:56.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.028+0000 7f926ac00640 1 Processor -- start 2024-09-17T03:13:56.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.029+0000 7f926ac00640 1 -- start start 2024-09-17T03:13:56.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.032+0000 7f926ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92641fcf10 0x7f92641f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.032+0000 7f926ac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.032+0000 7f926ac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9264161530 0x7f9264161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.032+0000 7f926ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92640cf6a0 con 0x7f92641fcf10 2024-09-17T03:13:56.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f9268e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f9268e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57198/0 (socket says 172.21.15.153:57198) 2024-09-17T03:13:56.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f9268e00640 1 -- 172.21.15.153:0/4210412565 learned_addr learned my addr 172.21.15.153:0/4210412565 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:56.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f92640cf520 con 0x7f926415b5f0 2024-09-17T03:13:56.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f92640cf820 con 0x7f9264161530 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f9269800640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92641fcf10 0x7f92641f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.033+0000 7f926a200640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9264161530 0x7f9264161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.034+0000 7f9268e00640 1 -- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9264161530 msgr2=0x7f9264161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.034+0000 7f9268e00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9264161530 0x7f9264161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.034+0000 7f9268e00640 1 -- 172.21.15.153:0/4210412565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92641fcf10 msgr2=0x7f92641f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.034+0000 7f9268e00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92641fcf10 0x7f92641f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.034+0000 7f9268e00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264161e80 con 0x7f926415b5f0 2024-09-17T03:13:56.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.037+0000 7f9268e00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9258006110 tx=0x7f92580065d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.037+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258015070 con 0x7f926415b5f0 2024-09-17T03:13:56.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.037+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925800fa80 con 0x7f926415b5f0 2024-09-17T03:13:56.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.037+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258011430 con 0x7f926415b5f0 2024-09-17T03:13:56.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.037+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641f9400 con 0x7f926415b5f0 2024-09-17T03:13:56.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.038+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92641f9990 con 0x7f926415b5f0 2024-09-17T03:13:56.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.039+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f926415e650 con 0x7f926415b5f0 2024-09-17T03:13:56.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.042+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92580115d0 con 0x7f926415b5f0 2024-09-17T03:13:56.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.044+0000 7f9261600640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 0x7f924407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:56.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.044+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f925809bd40 con 0x7f926415b5f0 2024-09-17T03:13:56.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.044+0000 7f9269800640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 0x7f924407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:56.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.045+0000 7f9269800640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 0x7f924407b170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9250034000 tx=0x7f92500046c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:56.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.048+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9264161e80 con 0x7f926415b5f0 2024-09-17T03:13:56.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.330+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f12a415ab30 con 0x7f12a415ef90 2024-09-17T03:13:56.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.331+0000 7f129aa00640 1 -- 172.21.15.153:0/598801214 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f129c083a40 con 0x7f12a415ef90 2024-09-17T03:13:56.331 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-09-17T03:13:56.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.335+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 msgr2=0x7f128407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.336+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 0x7f128407b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294009040 comp rx=0 tx=0).stop 2024-09-17T03:13:56.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.336+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 msgr2=0x7f12a4133840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.336+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 0x7f12a4133840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12a4070e70 tx=0x7f129c004270 comp rx=0 tx=0).stop 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 shutdown_connections 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1284078be0 0x7f128407b0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12a415ef90 0x7f12a4133840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12a4073ba0 0x7f12a4133300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 --2- 172.21.15.153:0/598801214 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12a406ef40 0x7f12a414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 >> 172.21.15.153:0/598801214 conn(0x7f12a40d0590 msgr2=0x7f12a4154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.337+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 shutdown_connections 2024-09-17T03:13:56.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.338+0000 7f12a9c00640 1 -- 172.21.15.153:0/598801214 wait complete. 2024-09-17T03:13:56.369 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.367+0000 7f86e7400640 1 -- 172.21.15.153:0/913938643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f86d0005850 con 0x7f86e00037a0 2024-09-17T03:13:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.368+0000 7f86f2000640 1 -- 172.21.15.153:0/913938643 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86fc0dea70 con 0x7f86e00037a0 2024-09-17T03:13:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.371+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 msgr2=0x7f86dc07b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.371+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 0x7f86dc07b2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86ec001c30 tx=0x7f86ec02d000 comp rx=0 tx=0).stop 2024-09-17T03:13:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.371+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 msgr2=0x7f86f41872d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.371+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86fc000b60 tx=0x7f86fc06af00 comp rx=0 tx=0).stop 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 shutdown_connections 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f86dc078d90 0x7f86dc07b2a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86f4034e50 0x7f86f404a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86f40de3d0 0x7f86f4034910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 --2- 172.21.15.153:0/913938643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e00037a0 0x7f86f41872d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 >> 172.21.15.153:0/913938643 conn(0x7f86f4051410 msgr2=0x7f86f40067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 shutdown_connections 2024-09-17T03:13:56.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.372+0000 7f8700e00640 1 -- 172.21.15.153:0/913938643 wait complete. 2024-09-17T03:13:56.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.0 2024-09-17T03:13:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.389+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f839c005580 con 0x7f83c413b930 2024-09-17T03:13:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.389+0000 7f83bbe00640 1 -- 172.21.15.153:0/3273706272 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83b0063750 con 0x7f83c413b930 2024-09-17T03:13:56.389 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 msgr2=0x7f83a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 0x7f83a407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83bc036040 tx=0x7f83bc00e040 comp rx=0 tx=0).stop 2024-09-17T03:13:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 msgr2=0x7f83c413bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 0x7f83c413bd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c940 tx=0x7f83b000ce00 comp rx=0 tx=0).stop 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 shutdown_connections 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f83a4078bc0 0x7f83a407b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c413c280 0x7f83c4152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f83c413b930 0x7f83c413bd40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 --2- 172.21.15.153:0/3273706272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a8003a70 0x7f83c414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 >> 172.21.15.153:0/3273706272 conn(0x7f83c40d05c0 msgr2=0x7f83c40ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.394+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 shutdown_connections 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.395+0000 7f83c9a00640 1 -- 172.21.15.153:0/3273706272 wait complete. 2024-09-17T03:13:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.395+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f204806d3c0 con 0x7f204815f6d0 2024-09-17T03:13:56.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.396+0000 7f203f400640 1 -- 172.21.15.153:0/2510551530 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2030016e10 con 0x7f204815f6d0 2024-09-17T03:13:56.395 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:56.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 msgr2=0x7f202407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 0x7f202407b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2038035000 tx=0x7f2038004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 msgr2=0x7f204814f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2030009fd0 tx=0x7f203000ec20 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 shutdown_connections 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2024078c60 0x7f202407b170 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2038035000 tx=0x7f2038004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2048162240 0x7f204814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f204815f6d0 0x7f204814f900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 --2- 172.21.15.153:0/2510551530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20480cef00 0x7f204814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.400+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 >> 172.21.15.153:0/2510551530 conn(0x7f20480d41e0 msgr2=0x7f20480b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.401+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 shutdown_connections 2024-09-17T03:13:56.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.401+0000 7f2047e00640 1 -- 172.21.15.153:0/2510551530 wait complete. 2024-09-17T03:13:56.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.407+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f65e40b6020 con 0x7f65e40cf6b0 2024-09-17T03:13:56.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.408+0000 7f65e0c00640 1 -- 172.21.15.153:0/1861527780 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65d0019e20 con 0x7f65e40cf6b0 2024-09-17T03:13:56.407 INFO:teuthology.orchestra.run.smithi153.stdout:64424509447 2024-09-17T03:13:56.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.410+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f39a8005580 con 0x7f39d80af4e0 2024-09-17T03:13:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.411+0000 7f39cea00640 1 -- 172.21.15.153:0/2431739014 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39d00674b0 con 0x7f39d80af4e0 2024-09-17T03:13:56.410 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.412+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 msgr2=0x7f65c407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.412+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 0x7f65c407b0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65dc005fd0 tx=0x7f65dc0094a0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.412+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 msgr2=0x7f65e409a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.412+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65d000e9f0 tx=0x7f65d000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 shutdown_connections 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65c4078be0 0x7f65c407b0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65e40cfac0 0x7f65e409af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65e40cf6b0 0x7f65e409a9e0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65d000e9f0 tx=0x7f65d000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 --2- 172.21.15.153:0/1861527780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65e4073000 0x7f65e415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 >> 172.21.15.153:0/1861527780 conn(0x7f65e40b1b90 msgr2=0x7f65e40ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.413+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 shutdown_connections 2024-09-17T03:13:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.414+0000 7f65eb400640 1 -- 172.21.15.153:0/1861527780 wait complete. 2024-09-17T03:13:56.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 msgr2=0x7f39b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 0x7f39b407b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39c00058c0 tx=0x7f39c0005850 comp rx=0 tx=0).stop 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 msgr2=0x7f39d8152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d8152070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39d000bdf0 tx=0x7f39d0009ef0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 shutdown_connections 2024-09-17T03:13:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39b4078b90 0x7f39b407b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39d80af4e0 0x7f39d8152070 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d8074880 0x7f39d80ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 --2- 172.21.15.153:0/2431739014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39d806f330 0x7f39d8159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 >> 172.21.15.153:0/2431739014 conn(0x7f39d80d0350 msgr2=0x7f39d80b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 shutdown_connections 2024-09-17T03:13:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.415+0000 7f39c7e00640 1 -- 172.21.15.153:0/2431739014 wait complete. 2024-09-17T03:13:56.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-09-17T03:13:56.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-09-17T03:13:56.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.443+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa8c00cf660 con 0x7fa8c0073990 2024-09-17T03:13:56.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.445+0000 7fa8b7400640 1 -- 172.21.15.153:0/3695552902 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8b8084610 con 0x7fa8c0073990 2024-09-17T03:13:56.444 INFO:teuthology.orchestra.run.smithi153.stdout:55834574858 2024-09-17T03:13:56.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-17T03:13:56.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-09-17T03:13:56.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.447+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f92641fd320 con 0x7f926415b5f0 2024-09-17T03:13:56.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.447+0000 7f9261600640 1 -- 172.21.15.153:0/4210412565 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9264161e80 con 0x7f926415b5f0 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 msgr2=0x7fa8a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 0x7fa8a007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0162900 tx=0x7fa8ac009040 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 msgr2=0x7fa8c01fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009b30 tx=0x7fa8b8003970 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 shutdown_connections 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa8a0078b90 0x7fa8a007b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0162360 0x7fa8c0153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa8c01557d0 0x7fa8c00ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 --2- 172.21.15.153:0/3695552902 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa8c0073990 0x7fa8c01fccb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 >> 172.21.15.153:0/3695552902 conn(0x7fa8c006cde0 msgr2=0x7fa8c006e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.448+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 shutdown_connections 2024-09-17T03:13:56.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.449+0000 7fa8c4e00640 1 -- 172.21.15.153:0/3695552902 wait complete. 2024-09-17T03:13:56.449 INFO:teuthology.orchestra.run.smithi153.stdout:64424509448 2024-09-17T03:13:56.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 msgr2=0x7f924407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 0x7f924407b170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9250034000 tx=0x7f92500046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 msgr2=0x7f92640ba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:56.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9258006110 tx=0x7f92580065d0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 shutdown_connections 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9244078c60 0x7f924407b170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9264161530 0x7f9264161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f926415b5f0 0x7f92640ba590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 --2- 172.21.15.153:0/4210412565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92641fcf10 0x7f92641f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.452+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 >> 172.21.15.153:0/4210412565 conn(0x7f92640d41e0 msgr2=0x7f92640b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.453+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 shutdown_connections 2024-09-17T03:13:56.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:56.453+0000 7f926ac00640 1 -- 172.21.15.153:0/4210412565 wait complete. 2024-09-17T03:13:56.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-09-17T03:13:56.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-09-17T03:13:57.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:13:57.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:13:57.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:13:57.438 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:13:57.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:13:57.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:13:57.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:13:57.475 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:13:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.710+0000 7f7fd7a00640 1 -- 172.21.15.153:0/1137533449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 msgr2=0x7f7fc8050fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.710+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/1137533449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc8050fe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fd006c0e0 tx=0x7f7fd00a6280 comp rx=0 tx=0).stop 2024-09-17T03:13:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.711+0000 7f7fd7a00640 1 -- 172.21.15.153:0/1137533449 shutdown_connections 2024-09-17T03:13:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.711+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/1137533449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc8050fe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.711+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/1137533449 >> v2:172.21.15.153:3300/0 conn(0x7f7fc80df3e0 0x7f7fc8034430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.711+0000 7f7fd7a00640 1 -- 172.21.15.153:0/1137533449 >> 172.21.15.153:0/1137533449 conn(0x7f7fc801d9d0 msgr2=0x7f7fc8039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.711+0000 7f7fd7a00640 1 -- 172.21.15.153:0/1137533449 shutdown_connections 2024-09-17T03:13:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.712+0000 7f7fd7a00640 1 -- 172.21.15.153:0/1137533449 wait complete. 2024-09-17T03:13:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.716+0000 7f7fd7a00640 1 Processor -- start 2024-09-17T03:13:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.717+0000 7f7fd7a00640 1 -- start start 2024-09-17T03:13:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.720+0000 7f7fd7a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.721+0000 7f7fd5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.721+0000 7f7fd5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56390/0 (socket says 172.21.15.153:56390) 2024-09-17T03:13:57.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.721+0000 7f7fd5000640 1 -- 172.21.15.153:0/4091369889 learned_addr learned my addr 172.21.15.153:0/4091369889 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.721+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc80da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.722+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 0x7f7fc80daa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.722+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80516a0 con 0x7f7fc80312c0 2024-09-17T03:13:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.722+0000 7f7fcfe00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc80da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.723+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8051520 con 0x7f7fc80316d0 2024-09-17T03:13:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.723+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc8051820 con 0x7f7fc80df3e0 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 0x7f7fc80daa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5000640 1 -- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 msgr2=0x7f7fc80daa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5000640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 0x7f7fc80daa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5000640 1 -- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 msgr2=0x7f7fc80da4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5000640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc80da4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.724+0000 7f7fd5000640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80daf70 con 0x7f7fc80312c0 2024-09-17T03:13:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.725+0000 7f7fd5a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 0x7f7fc80daa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.725+0000 7f7fcfe00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc80da4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:57.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.725+0000 7f7fd5000640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ed90 tx=0x7f7fc400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.726+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4009e10 con 0x7f7fc80312c0 2024-09-17T03:13:57.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.726+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc4004020 con 0x7f7fc80312c0 2024-09-17T03:13:57.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.726+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004450 con 0x7f7fc80312c0 2024-09-17T03:13:57.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.728+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc804def0 con 0x7f7fc80312c0 2024-09-17T03:13:57.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.728+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc804e4b0 con 0x7f7fc80312c0 2024-09-17T03:13:57.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.732+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc8007310 con 0x7f7fc80312c0 2024-09-17T03:13:57.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.737+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fc4005030 con 0x7f7fc80312c0 2024-09-17T03:13:57.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.745+0000 7f7fccc00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 0x7f7fb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.746+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7fc409b880 con 0x7f7fc80312c0 2024-09-17T03:13:57.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.747+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fc8007310 con 0x7f7fc80312c0 2024-09-17T03:13:57.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.756+0000 7f7fcfe00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 0x7f7fb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.760+0000 7f7fcfe00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 0x7f7fb007b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80d92d0 tx=0x7f7fbc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.785+0000 7f1527e00640 1 -- 172.21.15.153:0/3159715942 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514001710 con 0x7f15280af450 2024-09-17T03:13:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.785+0000 7f152fe00640 1 -- 172.21.15.153:0/3159715942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 msgr2=0x7f15280b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.785+0000 7f152fe00640 1 --2- 172.21.15.153:0/3159715942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f15280b31e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1528072640 tx=0x7f151c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.786+0000 7f152fe00640 1 -- 172.21.15.153:0/3159715942 shutdown_connections 2024-09-17T03:13:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.786+0000 7f152fe00640 1 --2- 172.21.15.153:0/3159715942 >> v2:172.21.15.153:3300/0 conn(0x7f1528074370 0x7f1528074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.786+0000 7f152fe00640 1 --2- 172.21.15.153:0/3159715942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f15280b31e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.786+0000 7f152fe00640 1 -- 172.21.15.153:0/3159715942 >> 172.21.15.153:0/3159715942 conn(0x7f15280d0350 msgr2=0x7f15280d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.786+0000 7f152fe00640 1 -- 172.21.15.153:0/3159715942 shutdown_connections 2024-09-17T03:13:57.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.787+0000 7f152fe00640 1 -- 172.21.15.153:0/3159715942 wait complete. 2024-09-17T03:13:57.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.792+0000 7f152fe00640 1 Processor -- start 2024-09-17T03:13:57.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.792+0000 7f152fe00640 1 -- start start 2024-09-17T03:13:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.795+0000 7f152fe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 0x7f1528145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.795+0000 7f152fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.796+0000 7f152fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f1528146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.796+0000 7f152ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.796+0000 7f152ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56398/0 (socket says 172.21.15.153:56398) 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.797+0000 7f152d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 0x7f1528145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.797+0000 7f152d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 0x7f1528145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56576/0 (socket says 172.21.15.153:56576) 2024-09-17T03:13:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.797+0000 7f152ca00640 1 -- 172.21.15.153:0/140903035 learned_addr learned my addr 172.21.15.153:0/140903035 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.797+0000 7f152fe00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1528074e40 con 0x7f1528074370 2024-09-17T03:13:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.797+0000 7f152fe00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1528074cc0 con 0x7f15280af450 2024-09-17T03:13:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.798+0000 7f152fe00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1528162520 con 0x7f152806edf0 2024-09-17T03:13:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.798+0000 7f152de00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f1528146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.800+0000 7f152ca00640 1 -- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 msgr2=0x7f1528145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.800+0000 7f152ca00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 0x7f1528145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.800+0000 7f152ca00640 1 -- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 msgr2=0x7f1528146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.800+0000 7f152ca00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f1528146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.800+0000 7f152ca00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1528146330 con 0x7f1528074370 2024-09-17T03:13:57.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.801+0000 7f152ca00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f152000cc90 tx=0x7f152000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.802+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520003b70 con 0x7f1528074370 2024-09-17T03:13:57.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.802+0000 7f152fe00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1528156ce0 con 0x7f1528074370 2024-09-17T03:13:57.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.802+0000 7f152fe00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1528145310 con 0x7f1528074370 2024-09-17T03:13:57.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.805+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1504005290 con 0x7f1528074370 2024-09-17T03:13:57.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.805+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1520003e00 con 0x7f1528074370 2024-09-17T03:13:57.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.806+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520004280 con 0x7f1528074370 2024-09-17T03:13:57.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.813+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1520004420 con 0x7f1528074370 2024-09-17T03:13:57.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.815+0000 7f1525600640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.815+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f152009c010 con 0x7f1528074370 2024-09-17T03:13:57.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.816+0000 7f152d400640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.819+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1520014030 con 0x7f1528074370 2024-09-17T03:13:57.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.821+0000 7f152d400640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 0x7f150807b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f151c034000 tx=0x7f151c0046c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.850+0000 7febb9400640 1 -- 172.21.15.153:0/2117602464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb406ddf0 msgr2=0x7febb406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.851+0000 7febb9400640 1 --2- 172.21.15.153:0/2117602464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb406ddf0 0x7febb406e200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feba0009860 tx=0x7feba002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.851+0000 7febb9400640 1 -- 172.21.15.153:0/2117602464 shutdown_connections 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.851+0000 7febb9400640 1 --2- 172.21.15.153:0/2117602464 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb406ddf0 0x7febb406e200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.851+0000 7febb9400640 1 -- 172.21.15.153:0/2117602464 >> 172.21.15.153:0/2117602464 conn(0x7febb40b1b90 msgr2=0x7febb40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.851+0000 7febb9400640 1 -- 172.21.15.153:0/2117602464 shutdown_connections 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.852+0000 7febb9400640 1 -- 172.21.15.153:0/2117602464 wait complete. 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.856+0000 7febb9400640 1 Processor -- start 2024-09-17T03:13:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.857+0000 7febb9400640 1 -- start start 2024-09-17T03:13:57.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 -- 172.21.15.153:0/279620063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 msgr2=0x7f0c4403c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 --2- 172.21.15.153:0/279620063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4403c1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c06c0e0 tx=0x7f0c4c0a6300 comp rx=0 tx=0).stop 2024-09-17T03:13:57.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 -- 172.21.15.153:0/279620063 shutdown_connections 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 --2- 172.21.15.153:0/279620063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4403c1f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 --2- 172.21.15.153:0/279620063 >> v2:172.21.15.153:3300/0 conn(0x7f0c44056da0 0x7f0c44057c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.859+0000 7f0c51600640 1 -- 172.21.15.153:0/279620063 >> 172.21.15.153:0/279620063 conn(0x7f0c4403a5f0 msgr2=0x7f0c4403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.860+0000 7f0c51600640 1 -- 172.21.15.153:0/279620063 shutdown_connections 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.860+0000 7f0c51600640 1 -- 172.21.15.153:0/279620063 wait complete. 2024-09-17T03:13:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.860+0000 7febb9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7f4035c00640 1 -- 172.21.15.153:0/2354436304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403015e1c0 msgr2=0x7f403015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7febb9400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb4072e70 0x7febb40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7febb9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febb415f030 0x7febb40b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7f4035c00640 1 --2- 172.21.15.153:0/2354436304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403015e1c0 0x7f403015e5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f402800afd0 tx=0x7f402802c6b0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7febb9400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febb415bf40 con 0x7febb406ddf0 2024-09-17T03:13:57.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7febb9400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7febb415bdc0 con 0x7febb415f030 2024-09-17T03:13:57.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.861+0000 7febb9400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7febb415c0c0 con 0x7febb4072e70 2024-09-17T03:13:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7f4035c00640 1 -- 172.21.15.153:0/2354436304 shutdown_connections 2024-09-17T03:13:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7f4035c00640 1 --2- 172.21.15.153:0/2354436304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4030151080 0x7f4030151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7f4035c00640 1 --2- 172.21.15.153:0/2354436304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f403015e1c0 0x7f403015e5d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7f4035c00640 1 -- 172.21.15.153:0/2354436304 >> 172.21.15.153:0/2354436304 conn(0x7f40300d05c0 msgr2=0x7f403006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7febb1e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb4072e70 0x7febb40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7febb2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.862+0000 7febb3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febb415f030 0x7febb40b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.863+0000 7febb2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56408/0 (socket says 172.21.15.153:56408) 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.863+0000 7febb2800640 1 -- 172.21.15.153:0/3631338949 learned_addr learned my addr 172.21.15.153:0/3631338949 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.863+0000 7f4035c00640 1 -- 172.21.15.153:0/2354436304 shutdown_connections 2024-09-17T03:13:57.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.863+0000 7f4035c00640 1 -- 172.21.15.153:0/2354436304 wait complete. 2024-09-17T03:13:57.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7febb2800640 1 -- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb4072e70 msgr2=0x7febb40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7febb2800640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb4072e70 0x7febb40b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7febb2800640 1 -- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febb415f030 msgr2=0x7febb40b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7febb2800640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febb415f030 0x7febb40b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7febb2800640 1 -- 172.21.15.153:0/3631338949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb409aa80 con 0x7febb406ddf0 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.865+0000 7febb2800640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feba400c760 tx=0x7feba400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7f0c51600640 1 Processor -- start 2024-09-17T03:13:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.864+0000 7f0c51600640 1 -- start start 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.866+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4016020 con 0x7febb406ddf0 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.866+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba400a730 con 0x7febb406ddf0 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.866+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba400ab60 con 0x7febb406ddf0 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.866+0000 7f0c51600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c51600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c44056da0 0x7f0c440db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c51600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 0x7f0c44039780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c51600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44007060 con 0x7f0c440e2f40 2024-09-17T03:13:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb41f7030 con 0x7febb406ddf0 2024-09-17T03:13:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c51600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44006ee0 con 0x7f0c44056da0 2024-09-17T03:13:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb40a08f0 con 0x7febb406ddf0 2024-09-17T03:13:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c51600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440071e0 con 0x7f0c44054360 2024-09-17T03:13:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f4035c00640 1 Processor -- start 2024-09-17T03:13:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f4035c00640 1 -- start start 2024-09-17T03:13:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56628/0 (socket says 172.21.15.153:56628) 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.867+0000 7f0c4be00640 1 -- 172.21.15.153:0/2613135368 learned_addr learned my addr 172.21.15.153:0/2613135368 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c50c00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 0x7f0c44039780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 -- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c44056da0 msgr2=0x7f0c440db2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c44056da0 0x7f0c440db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 -- 172.21.15.153:0/2613135368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 msgr2=0x7f0c44039780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 0x7f0c44039780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 -- 172.21.15.153:0/2613135368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4404d780 con 0x7f0c44054360 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c50c00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 0x7f0c44039780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.868+0000 7f0c4be00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000d780 tx=0x7f0c4000dc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40017070 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c4000de90 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004020 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4404da60 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.869+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c44051130 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.871+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44007680 con 0x7f0c44054360 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.872+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb415c5e0 con 0x7febb406ddf0 2024-09-17T03:13:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.874+0000 7f4035c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 0x7f40301fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.874+0000 7f4035c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 0x7f40300cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.874+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feba4019020 con 0x7febb406ddf0 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4030070de0 con 0x7f4030151080 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4030070c60 con 0x7f403015ab80 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56650/0 (socket says 172.21.15.153:56650) 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f4035200640 1 -- 172.21.15.153:0/1631968725 learned_addr learned my addr 172.21.15.153:0/1631968725 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.876+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f403015b6a0 con 0x7f403015e1c0 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.876+0000 7f402fe00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 0x7f40301fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.876+0000 7f402f400640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 0x7f40300cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.875+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c400041c0 con 0x7f0c44054360 2024-09-17T03:13:57.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.876+0000 7f0c3fe00640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 0x7f0c2c07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0c4005ead0 con 0x7f0c44054360 2024-09-17T03:13:57.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7febaaa00640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 0x7feb9407f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.876+0000 7f4035200640 1 -- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 msgr2=0x7f40300cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f0c4b400640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 0x7f0c2c07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.878+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feba409ae50 con 0x7febb406ddf0 2024-09-17T03:13:57.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f4035200640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 0x7f40300cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f4035200640 1 -- 172.21.15.153:0/1631968725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 msgr2=0x7f40301fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f4035200640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 0x7f40301fd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f4035200640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40301fa690 con 0x7f403015e1c0 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.877+0000 7f402fe00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 0x7f40301fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.878+0000 7f402f400640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 0x7f40300cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:57.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.878+0000 7febb1e00640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 0x7feb9407f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.878+0000 7f4035200640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401800c700 tx=0x7f401800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f0c4b400640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 0x7f0c2c07b120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c440e1c40 tx=0x7f0c38006ba0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018016020 con 0x7f403015e1c0 2024-09-17T03:13:57.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f401800a930 con 0x7f403015e1c0 2024-09-17T03:13:57.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800ad60 con 0x7f403015e1c0 2024-09-17T03:13:57.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40300cbbf0 con 0x7f403015e1c0 2024-09-17T03:13:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7febb1e00640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 0x7feb9407f4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feba0034000 tx=0x7feba0004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40301fa0d0 con 0x7f403015e1c0 2024-09-17T03:13:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.879+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c40062f60 con 0x7f0c44054360 2024-09-17T03:13:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.880+0000 7fb8d2600640 1 -- 172.21.15.153:0/2901297066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0aee70 msgr2=0x7fb8cc072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.880+0000 7fb8d2600640 1 --2- 172.21.15.153:0/2901297066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0aee70 0x7fb8cc072f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc072d20 tx=0x7fb8b802a440 comp rx=0 tx=0).stop 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 -- 172.21.15.153:0/2901297066 shutdown_connections 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 --2- 172.21.15.153:0/2901297066 >> v2:172.21.15.164:3300/0 conn(0x7fb8cc15faf0 0x7fb8cc162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 --2- 172.21.15.153:0/2901297066 >> v2:172.21.15.153:3300/0 conn(0x7fb8cc0cc160 0x7fb8cc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 --2- 172.21.15.153:0/2901297066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0aee70 0x7fb8cc072f90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 -- 172.21.15.153:0/2901297066 >> 172.21.15.153:0/2901297066 conn(0x7fb8cc0b1b90 msgr2=0x7fb8cc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4030151490 con 0x7f403015e1c0 2024-09-17T03:13:57.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 -- 172.21.15.153:0/2901297066 shutdown_connections 2024-09-17T03:13:57.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.881+0000 7fb8d2600640 1 -- 172.21.15.153:0/2901297066 wait complete. 2024-09-17T03:13:57.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.884+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feba4020030 con 0x7febb406ddf0 2024-09-17T03:13:57.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.885+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4018019020 con 0x7f403015e1c0 2024-09-17T03:13:57.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.885+0000 7fb8d2600640 1 Processor -- start 2024-09-17T03:13:57.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.885+0000 7fb8d2600640 1 -- start start 2024-09-17T03:13:57.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.887+0000 7f4027e00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 0x7f400c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.887+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f401809b300 con 0x7f403015e1c0 2024-09-17T03:13:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0cc160 0x7fb8cc09d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8cc15faf0 0x7fb8cc1f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc06ddf0 con 0x7fb8cc0aee70 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc162cb0 con 0x7fb8cc15faf0 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8d2600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb8cc06df70 con 0x7fb8cc0cc160 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8cb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7fb8cb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56446/0 (socket says 172.21.15.153:56446) 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.889+0000 7fb8cb400640 1 -- 172.21.15.153:0/2156835401 learned_addr learned my addr 172.21.15.153:0/2156835401 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.889+0000 7fb8cbe00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8cc15faf0 0x7fb8cc1f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.889+0000 7fb8caa00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0cc160 0x7fb8cc09d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.888+0000 7f402fe00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 0x7f400c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 -- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0cc160 msgr2=0x7fb8cc09d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0cc160 0x7fb8cc09d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 -- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8cc15faf0 msgr2=0x7fb8cc1f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8cc15faf0 0x7fb8cc1f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 -- 172.21.15.153:0/2156835401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc09e810 con 0x7fb8cc0aee70 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7f402fe00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 0x7f400c07b170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4028035000 tx=0x7f402800c040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f403015eb10 con 0x7f403015e1c0 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.890+0000 7fb8cb400640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009910 tx=0x7fb8b80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.891+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803f070 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.891+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b8004250 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.893+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803f070 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.893+0000 7fb8d2600640 1 -- 172.21.15.153:0/2156835401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc09eaf0 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.893+0000 7fb8d2600640 1 -- 172.21.15.153:0/2156835401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc09f0b0 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.897+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8b8042070 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.899+0000 7fb8c3400640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 0x7fb8ac07b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.899+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8b8004050 con 0x7fb8cc0aee70 2024-09-17T03:13:57.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.900+0000 7fb8caa00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 0x7fb8ac07b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.900+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc06e420 con 0x7fb8cc0aee70 2024-09-17T03:13:57.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.901+0000 7fb8caa00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 0x7fb8ac07b4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0b1960 tx=0x7fb8c40094f0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.911+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb8b80837c0 con 0x7fb8cc0aee70 2024-09-17T03:13:57.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.923+0000 7fbb27200640 1 -- 172.21.15.153:0/2511203361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7690 msgr2=0x7fbb280d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.923+0000 7fbb27200640 1 --2- 172.21.15.153:0/2511203361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7690 0x7fbb280d33a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005fd0 tx=0x7fbb1002a490 comp rx=0 tx=0).stop 2024-09-17T03:13:57.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.923+0000 7fbb27200640 1 -- 172.21.15.153:0/2511203361 shutdown_connections 2024-09-17T03:13:57.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.923+0000 7fbb27200640 1 --2- 172.21.15.153:0/2511203361 >> v2:172.21.15.164:3300/0 conn(0x7fbb280b7aa0 0x7fbb2806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.923+0000 7fbb27200640 1 --2- 172.21.15.153:0/2511203361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7690 0x7fbb280d33a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.924+0000 7fbb27200640 1 -- 172.21.15.153:0/2511203361 >> 172.21.15.153:0/2511203361 conn(0x7fbb280d0c70 msgr2=0x7fbb280d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.924+0000 7fbb27200640 1 -- 172.21.15.153:0/2511203361 shutdown_connections 2024-09-17T03:13:57.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.924+0000 7fbb27200640 1 -- 172.21.15.153:0/2511203361 wait complete. 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.927+0000 7fe18d000640 1 -- 172.21.15.153:0/1807184111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188162240 msgr2=0x7fe188162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.927+0000 7fe18d000640 1 --2- 172.21.15.153:0/1807184111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188162240 0x7fe188162650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe188162180 tx=0x7fe17402a590 comp rx=0 tx=0).stop 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 -- 172.21.15.153:0/1807184111 shutdown_connections 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 --2- 172.21.15.153:0/1807184111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe188162240 0x7fe188162650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 --2- 172.21.15.153:0/1807184111 >> v2:172.21.15.153:3300/0 conn(0x7fe1880cef00 0x7fe1880cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 --2- 172.21.15.153:0/1807184111 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe18815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 -- 172.21.15.153:0/1807184111 >> 172.21.15.153:0/1807184111 conn(0x7fe1880d41e0 msgr2=0x7fe1880d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 -- 172.21.15.153:0/1807184111 shutdown_connections 2024-09-17T03:13:57.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.928+0000 7fe18d000640 1 -- 172.21.15.153:0/1807184111 wait complete. 2024-09-17T03:13:57.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.929+0000 7fbb27200640 1 Processor -- start 2024-09-17T03:13:57.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.929+0000 7fbb27200640 1 -- start start 2024-09-17T03:13:57.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.932+0000 7fe18d000640 1 Processor -- start 2024-09-17T03:13:57.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.932+0000 7fbb27200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb280b7690 0x7fbb28160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb27200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7aa0 0x7fbb2815a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb27200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb27200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28162730 con 0x7fbb280b7690 2024-09-17T03:13:57.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb27200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbb281625b0 con 0x7fbb280d38e0 2024-09-17T03:13:57.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb27200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbb281628b0 con 0x7fbb280b7aa0 2024-09-17T03:13:57.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.933+0000 7fbb26800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.934+0000 7fbb26800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57336/0 (socket says 172.21.15.153:57336) 2024-09-17T03:13:57.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.934+0000 7fbb26800640 1 -- 172.21.15.153:0/3046934350 learned_addr learned my addr 172.21.15.153:0/3046934350 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.934+0000 7fbb25e00640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb280b7690 0x7fbb28160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fbb26800640 1 -- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7aa0 msgr2=0x7fbb2815a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.932+0000 7fe18d000640 1 -- start start 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.934+0000 7fe18d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1880cef00 0x7fe1880cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.934+0000 7fe18d000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe18d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 0x7fe1880ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe18d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe18815eb00 con 0x7fe188162240 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe18d000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe18806dce0 con 0x7fe1880cef00 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe18d000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe188162b90 con 0x7fe18815f6d0 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe186a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe186a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56680/0 (socket says 172.21.15.153:56680) 2024-09-17T03:13:57.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe186a00640 1 -- 172.21.15.153:0/249180155 learned_addr learned my addr 172.21.15.153:0/249180155 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe187400640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1880cef00 0x7fe1880cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fe187e00640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 0x7fe1880ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fbb26800640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7aa0 0x7fbb2815a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fbb26800640 1 -- 172.21.15.153:0/3046934350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb280b7690 msgr2=0x7fbb28160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fbb26800640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb280b7690 0x7fbb28160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.935+0000 7fbb26800640 1 -- 172.21.15.153:0/3046934350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb281fd2d0 con 0x7fbb280d38e0 2024-09-17T03:13:57.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe186a00640 1 -- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1880cef00 msgr2=0x7fe1880cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fbb26800640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000ba10 tx=0x7fbb2000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe186a00640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1880cef00 0x7fe1880cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe186a00640 1 -- 172.21.15.153:0/249180155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 msgr2=0x7fe1880ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe186a00640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 0x7fe1880ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe186a00640 1 -- 172.21.15.153:0/249180155 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1881f5940 con 0x7fe18815f6d0 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fe187e00640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 0x7fe1880ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.937+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20019070 con 0x7fbb280d38e0 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.938+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb2000cc30 con 0x7fbb280d38e0 2024-09-17T03:13:57.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.938+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb200146a0 con 0x7fbb280d38e0 2024-09-17T03:13:57.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.938+0000 7fe186a00640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe18000cc30 tx=0x7fe18000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.938+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb281fd5b0 con 0x7fbb280d38e0 2024-09-17T03:13:57.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.938+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281fdb70 con 0x7fbb280d38e0 2024-09-17T03:13:57.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.939+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb280d33a0 con 0x7fbb280d38e0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.939+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180003b70 con 0x7fe18815f6d0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.940+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18000ae50 con 0x7fe18815f6d0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.940+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1881f5c20 con 0x7fe18815f6d0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.940+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180004280 con 0x7fe18815f6d0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.940+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1881f61e0 con 0x7fe18815f6d0 2024-09-17T03:13:57.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.941+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe188163040 con 0x7fe18815f6d0 2024-09-17T03:13:57.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.943+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb2001c070 con 0x7fbb280d38e0 2024-09-17T03:13:57.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.945+0000 7fbb1e000640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 0x7fbb0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.945+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbb2009af30 con 0x7fbb280d38e0 2024-09-17T03:13:57.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.944+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe180004420 con 0x7fe18815f6d0 2024-09-17T03:13:57.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.945+0000 7fe17f400640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 0x7fe16807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:57.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.946+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe18009b940 con 0x7fe18815f6d0 2024-09-17T03:13:57.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.946+0000 7fe187400640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 0x7fe16807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.947+0000 7fbb25e00640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 0x7fbb0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:57.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.948+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb2000ce20 con 0x7fbb280d38e0 2024-09-17T03:13:57.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.948+0000 7fe187400640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 0x7fe16807b170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe178004510 tx=0x7fe17800b390 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.948+0000 7fbb25e00640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 0x7fbb0407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb10033000 tx=0x7fbb10004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:57.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:57.950+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe180014030 con 0x7fe18815f6d0 2024-09-17T03:13:58.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.158+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7fc8051d80 con 0x7f7fc80312c0 2024-09-17T03:13:58.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.159+0000 7f7fccc00640 1 -- 172.21.15.153:0/4091369889 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7fc4063970 con 0x7f7fc80312c0 2024-09-17T03:13:58.158 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:58.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.163+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 msgr2=0x7f7fb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.163+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 0x7f7fb007b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80d92d0 tx=0x7f7fbc009040 comp rx=0 tx=0).stop 2024-09-17T03:13:58.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.163+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 msgr2=0x7f7fc80d3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.164+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ed90 tx=0x7f7fc400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.164+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 shutdown_connections 2024-09-17T03:13:58.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.164+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7fb0078bc0 0x7f7fb007b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.164+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fc80df3e0 0x7f7fc80daa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.164+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fc80316d0 0x7f7fc80da4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.165+0000 7f7fd7a00640 1 --2- 172.21.15.153:0/4091369889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7fc80312c0 0x7f7fc80d3cc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.165+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 >> 172.21.15.153:0/4091369889 conn(0x7f7fc801d9d0 msgr2=0x7f7fc80059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.165+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 shutdown_connections 2024-09-17T03:13:58.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.165+0000 7f7fd7a00640 1 -- 172.21.15.153:0/4091369889 wait complete. 2024-09-17T03:13:58.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.0 2024-09-17T03:13:58.206 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.246+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1504005850 con 0x7f1528074370 2024-09-17T03:13:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.246+0000 7f1525600640 1 -- 172.21.15.153:0/140903035 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1520063aa0 con 0x7f1528074370 2024-09-17T03:13:58.246 INFO:teuthology.orchestra.run.smithi153.stdout:64424509450 2024-09-17T03:13:58.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.250+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 msgr2=0x7f150807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.250+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 0x7f150807b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f151c034000 tx=0x7f151c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.250+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 msgr2=0x7f152815e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.250+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f152000cc90 tx=0x7f152000a620 comp rx=0 tx=0).stop 2024-09-17T03:13:58.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 shutdown_connections 2024-09-17T03:13:58.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1508078b90 0x7f150807b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15280af450 0x7f1528146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528074370 0x7f152815e4a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 --2- 172.21.15.153:0/140903035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f152806edf0 0x7f1528145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 >> 172.21.15.153:0/140903035 conn(0x7f15280d0350 msgr2=0x7f15281629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.251+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 shutdown_connections 2024-09-17T03:13:58.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.252+0000 7f151aa00640 1 -- 172.21.15.153:0/140903035 wait complete. 2024-09-17T03:13:58.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.288+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbb280d22e0 con 0x7fbb280d38e0 2024-09-17T03:13:58.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.2 2024-09-17T03:13:58.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.289+0000 7fbb1e000640 1 -- 172.21.15.153:0/3046934350 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb20062a50 con 0x7fbb280d38e0 2024-09-17T03:13:58.289 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.289 INFO:teuthology.orchestra.run.smithi153.stdout:55834574859 2024-09-17T03:13:58.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 msgr2=0x7fbb0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 0x7fbb0407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb10033000 tx=0x7fbb10004730 comp rx=0 tx=0).stop 2024-09-17T03:13:58.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 msgr2=0x7fbb280b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000ba10 tx=0x7fbb2000bed0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 shutdown_connections 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb04078b90 0x7fbb0407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb280d38e0 0x7fbb280b53f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb280b7aa0 0x7fbb2815a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 --2- 172.21.15.153:0/3046934350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb280b7690 0x7fbb28160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 >> 172.21.15.153:0/3046934350 conn(0x7fbb280d0c70 msgr2=0x7fbb2815d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 shutdown_connections 2024-09-17T03:13:58.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.292+0000 7fbb27200640 1 -- 172.21.15.153:0/3046934350 wait complete. 2024-09-17T03:13:58.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.307+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0c4404c3d0 con 0x7f0c44054360 2024-09-17T03:13:58.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.308+0000 7f0c3fe00640 1 -- 172.21.15.153:0/2613135368 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c40067340 con 0x7f0c44054360 2024-09-17T03:13:58.309 INFO:teuthology.orchestra.run.smithi153.stdout:64424509449 2024-09-17T03:13:58.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 msgr2=0x7f0c2c07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 0x7f0c2c07b120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c440e1c40 tx=0x7f0c38006ba0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 msgr2=0x7f0c4404f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000d780 tx=0x7f0c4000dc40 comp rx=0 tx=0).stop 2024-09-17T03:13:58.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 shutdown_connections 2024-09-17T03:13:58.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0c2c078c10 0x7f0c2c07b120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c440e2f40 0x7f0c44039780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c44056da0 0x7f0c440db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 --2- 172.21.15.153:0/2613135368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0c44054360 0x7f0c4404f410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 >> 172.21.15.153:0/2613135368 conn(0x7f0c4403a5f0 msgr2=0x7f0c44053bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 shutdown_connections 2024-09-17T03:13:58.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.312+0000 7f0c51600640 1 -- 172.21.15.153:0/2613135368 wait complete. 2024-09-17T03:13:58.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.313+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7febb40b1650 con 0x7febb406ddf0 2024-09-17T03:13:58.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.314+0000 7febaaa00640 1 -- 172.21.15.153:0/3631338949 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feba409c020 con 0x7febb406ddf0 2024-09-17T03:13:58.313 INFO:teuthology.orchestra.run.smithi153.stdout:64424509450 2024-09-17T03:13:58.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-09-17T03:13:58.314 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.317+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb8cc070c60 con 0x7fb8cc0aee70 2024-09-17T03:13:58.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.317+0000 7fb8c3400640 1 -- 172.21.15.153:0/2156835401 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8b808a0c0 con 0x7fb8cc0aee70 2024-09-17T03:13:58.317 INFO:teuthology.orchestra.run.smithi153.stdout:64424509450 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 msgr2=0x7feb9407f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 0x7feb9407f4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feba0034000 tx=0x7feba0004730 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 msgr2=0x7febb41f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feba400c760 tx=0x7feba400cc20 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 shutdown_connections 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb9407cfd0 0x7feb9407f4e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febb415f030 0x7febb40b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febb4072e70 0x7febb40b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 --2- 172.21.15.153:0/3631338949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febb406ddf0 0x7febb41f3020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 >> 172.21.15.153:0/3631338949 conn(0x7febb40b1b90 msgr2=0x7febb415dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 shutdown_connections 2024-09-17T03:13:58.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.318+0000 7febb9400640 1 -- 172.21.15.153:0/3631338949 wait complete. 2024-09-17T03:13:58.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.321+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 msgr2=0x7fb8ac07b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.321+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 0x7fb8ac07b4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0b1960 tx=0x7fb8c40094f0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 msgr2=0x7fb8cc09cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009910 tx=0x7fb8b80052f0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 shutdown_connections 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb8ac078f90 0x7fb8ac07b4a0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0b1960 tx=0x7fb8c40094f0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb8cc15faf0 0x7fb8cc1f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb8cc0cc160 0x7fb8cc09d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 --2- 172.21.15.153:0/2156835401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8cc0aee70 0x7fb8cc09cbb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 >> 172.21.15.153:0/2156835401 conn(0x7fb8cc0b1b90 msgr2=0x7fb8cc0b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 shutdown_connections 2024-09-17T03:13:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.322+0000 7fb8c0c00640 1 -- 172.21.15.153:0/2156835401 wait complete. 2024-09-17T03:13:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.323+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f40301f9b80 con 0x7f403015e1c0 2024-09-17T03:13:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.324+0000 7f4027e00640 1 -- 172.21.15.153:0/1631968725 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4018062e20 con 0x7f403015e1c0 2024-09-17T03:13:58.323 INFO:teuthology.orchestra.run.smithi153.stdout:64424509451 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 msgr2=0x7f400c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 0x7f400c07b170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4028035000 tx=0x7f402800c040 comp rx=0 tx=0).stop 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 msgr2=0x7f403014f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401800c700 tx=0x7f401800cbc0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 shutdown_connections 2024-09-17T03:13:58.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f400c078c60 0x7f400c07b170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403015e1c0 0x7f403014f300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403015ab80 0x7f40300cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 --2- 172.21.15.153:0/1631968725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4030151080 0x7f40301fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 >> 172.21.15.153:0/1631968725 conn(0x7f40300d05c0 msgr2=0x7f403015bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 shutdown_connections 2024-09-17T03:13:58.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.327+0000 7f4035c00640 1 -- 172.21.15.153:0/1631968725 wait complete. 2024-09-17T03:13:58.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.1 2024-09-17T03:13:58.343 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2024-09-17T03:13:58.344 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.3 2024-09-17T03:13:58.351 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.5 2024-09-17T03:13:58.358 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.366+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe1880b9810 con 0x7fe18815f6d0 2024-09-17T03:13:58.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.367+0000 7fe17f400640 1 -- 172.21.15.153:0/249180155 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1800633d0 con 0x7fe18815f6d0 2024-09-17T03:13:58.366 INFO:teuthology.orchestra.run.smithi153.stdout:64424509450 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.369+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 msgr2=0x7fe16807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.369+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 0x7fe16807b170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe178004510 tx=0x7fe17800b390 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.369+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 msgr2=0x7fe1880b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.369+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe18000cc30 tx=0x7fe18000a620 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 shutdown_connections 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe168078c60 0x7fe16807b170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe188162240 0x7fe1880ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe18815f6d0 0x7fe1880b31f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 --2- 172.21.15.153:0/249180155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1880cef00 0x7fe1880cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 >> 172.21.15.153:0/249180155 conn(0x7fe1880d41e0 msgr2=0x7fe1880b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 shutdown_connections 2024-09-17T03:13:58.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.370+0000 7fe18d000640 1 -- 172.21.15.153:0/249180155 wait complete. 2024-09-17T03:13:58.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.7 2024-09-17T03:13:58.393 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:58.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:13:58.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 -- 172.21.15.153:0/675210831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04073dd0 msgr2=0x7f9b0406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/675210831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04073dd0 0x7f9b0406ddf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009860 tx=0x7f9aec02a5a0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 -- 172.21.15.153:0/675210831 shutdown_connections 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/675210831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04073dd0 0x7f9b0406ddf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 -- 172.21.15.153:0/675210831 >> 172.21.15.153:0/675210831 conn(0x7f9b040cca40 msgr2=0x7f9b040cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.656+0000 7f9b0bc00640 1 -- 172.21.15.153:0/675210831 shutdown_connections 2024-09-17T03:13:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.657+0000 7f9b0bc00640 1 -- 172.21.15.153:0/675210831 wait complete. 2024-09-17T03:13:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.659+0000 7f9b0bc00640 1 Processor -- start 2024-09-17T03:13:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.659+0000 7f9b0bc00640 1 -- start start 2024-09-17T03:13:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 0x7f9b040a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 0x7f9b040c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0406f670 con 0x7f9b04073dd0 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0406f4f0 con 0x7f9b0406e330 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.660+0000 7f9b0bc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0406f7f0 con 0x7f9b04074cb0 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56488/0 (socket says 172.21.15.153:56488) 2024-09-17T03:13:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 -- 172.21.15.153:0/3761802528 learned_addr learned my addr 172.21.15.153:0/3761802528 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9b09c00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 0x7f9b040c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9b09200640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 0x7f9b040a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 -- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 msgr2=0x7f9b040c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 0x7f9b040c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 -- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 msgr2=0x7f9b040a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 0x7f9b040a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 -- 172.21.15.153:0/3761802528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b040b38f0 con 0x7f9b04073dd0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9b09c00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 0x7f9b040c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9b09200640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 0x7f9b040a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9afbe00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9aec02ab90 tx=0x7f9aec033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.661+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec031b50 con 0x7f9b04073dd0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.662+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b040a11d0 con 0x7f9b04073dd0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.662+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aec031de0 con 0x7f9b04073dd0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.662+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec033330 con 0x7f9b04073dd0 2024-09-17T03:13:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.662+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b041f59a0 con 0x7f9b04073dd0 2024-09-17T03:13:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.663+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0406ddf0 con 0x7f9b04073dd0 2024-09-17T03:13:58.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.664+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9aec0334d0 con 0x7f9b04073dd0 2024-09-17T03:13:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.666+0000 7f9b01600640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 0x7f9ae007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.666+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9aec0bc3f0 con 0x7f9b04073dd0 2024-09-17T03:13:58.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.666+0000 7f9b09200640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 0x7f9ae007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:58.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.667+0000 7f9b09200640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 0x7f9ae007b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9af4001220 tx=0x7f9af4009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:58.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.670+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b040a11d0 con 0x7f9b04073dd0 2024-09-17T03:13:58.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.852+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b041f6610 con 0x7f9ae0078bc0 2024-09-17T03:13:58.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.858+0000 7f9b01600640 1 -- 172.21.15.153:0/3761802528 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f9af4001c60 con 0x7f9ae0078bc0 2024-09-17T03:13:58.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:58.863 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:13:58.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 msgr2=0x7f9ae007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 0x7f9ae007b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9af4001220 tx=0x7f9af4009040 comp rx=0 tx=0).stop 2024-09-17T03:13:58.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 msgr2=0x7f9b040b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9aec02ab90 tx=0x7f9aec033ba0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 shutdown_connections 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ae0078bc0 0x7f9ae007b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b04074cb0 0x7f9b040c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b04073dd0 0x7f9b040b2e10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 --2- 172.21.15.153:0/3761802528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b0406e330 0x7f9b040a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 >> 172.21.15.153:0/3761802528 conn(0x7f9b040cca40 msgr2=0x7f9b040ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 shutdown_connections 2024-09-17T03:13:58.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:58.863+0000 7f9b0bc00640 1 -- 172.21.15.153:0/3761802528 wait complete. 2024-09-17T03:13:58.888 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-17T03:13:58.823469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3514368,"data_stored":2081512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003781"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160943+0000","last_change":"2024-09-17T03:13:33.123350+0000","last_active":"2024-09-17T03:13:39.160943+0000","last_peered":"2024-09-17T03:13:39.160943+0000","last_clean":"2024-09-17T03:13:39.160943+0000","last_became_active":"2024-09-17T03:13:33.122982+0000","last_became_peered":"2024-09-17T03:13:33.122982+0000","last_unstale":"2024-09-17T03:13:39.160943+0000","last_undegraded":"2024-09-17T03:13:39.160943+0000","last_fullsized":"2024-09-17T03:13:39.160943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.030877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159339+0000","last_change":"2024-09-17T03:13:34.133910+0000","last_active":"2024-09-17T03:13:39.159339+0000","last_peered":"2024-09-17T03:13:39.159339+0000","last_clean":"2024-09-17T03:13:39.159339+0000","last_became_active":"2024-09-17T03:13:34.133495+0000","last_became_peered":"2024-09-17T03:13:34.133495+0000","last_unstale":"2024-09-17T03:13:39.159339+0000","last_undegraded":"2024-09-17T03:13:39.159339+0000","last_fullsized":"2024-09-17T03:13:39.159339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:06.942420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194823+0000","last_change":"2024-09-17T03:13:38.178584+0000","last_active":"2024-09-17T03:13:39.194823+0000","last_peered":"2024-09-17T03:13:39.194823+0000","last_clean":"2024-09-17T03:13:39.194823+0000","last_became_active":"2024-09-17T03:13:38.176304+0000","last_became_peered":"2024-09-17T03:13:38.176304+0000","last_unstale":"2024-09-17T03:13:39.194823+0000","last_undegraded":"2024-09-17T03:13:39.194823+0000","last_fullsized":"2024-09-17T03:13:39.194823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:12.541698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159446+0000","last_change":"2024-09-17T03:13:33.127434+0000","last_active":"2024-09-17T03:13:39.159446+0000","last_peered":"2024-09-17T03:13:39.159446+0000","last_clean":"2024-09-17T03:13:39.159446+0000","last_became_active":"2024-09-17T03:13:33.127048+0000","last_became_peered":"2024-09-17T03:13:33.127048+0000","last_unstale":"2024-09-17T03:13:39.159446+0000","last_undegraded":"2024-09-17T03:13:39.159446+0000","last_fullsized":"2024-09-17T03:13:39.159446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159903+0000","last_change":"2024-09-17T03:13:34.133739+0000","last_active":"2024-09-17T03:13:39.159903+0000","last_peered":"2024-09-17T03:13:39.159903+0000","last_clean":"2024-09-17T03:13:39.159903+0000","last_became_active":"2024-09-17T03:13:34.132902+0000","last_became_peered":"2024-09-17T03:13:34.132902+0000","last_unstale":"2024-09-17T03:13:39.159903+0000","last_undegraded":"2024-09-17T03:13:39.159903+0000","last_fullsized":"2024-09-17T03:13:39.159903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194767+0000","last_change":"2024-09-17T03:13:38.169585+0000","last_active":"2024-09-17T03:13:39.194767+0000","last_peered":"2024-09-17T03:13:39.194767+0000","last_clean":"2024-09-17T03:13:39.194767+0000","last_became_active":"2024-09-17T03:13:38.169149+0000","last_became_peered":"2024-09-17T03:13:38.169149+0000","last_unstale":"2024-09-17T03:13:39.194767+0000","last_undegraded":"2024-09-17T03:13:39.194767+0000","last_fullsized":"2024-09-17T03:13:39.194767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.817523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197699+0000","last_change":"2024-09-17T03:13:33.136982+0000","last_active":"2024-09-17T03:13:39.197699+0000","last_peered":"2024-09-17T03:13:39.197699+0000","last_clean":"2024-09-17T03:13:39.197699+0000","last_became_active":"2024-09-17T03:13:33.136263+0000","last_became_peered":"2024-09-17T03:13:33.136263+0000","last_unstale":"2024-09-17T03:13:39.197699+0000","last_undegraded":"2024-09-17T03:13:39.197699+0000","last_fullsized":"2024-09-17T03:13:39.197699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:15.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195911+0000","last_change":"2024-09-17T03:13:34.131912+0000","last_active":"2024-09-17T03:13:39.195911+0000","last_peered":"2024-09-17T03:13:39.195911+0000","last_clean":"2024-09-17T03:13:39.195911+0000","last_became_active":"2024-09-17T03:13:34.130908+0000","last_became_peered":"2024-09-17T03:13:34.130908+0000","last_unstale":"2024-09-17T03:13:39.195911+0000","last_undegraded":"2024-09-17T03:13:39.195911+0000","last_fullsized":"2024-09-17T03:13:39.195911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:09.565865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196018+0000","last_change":"2024-09-17T03:13:38.170051+0000","last_active":"2024-09-17T03:13:39.196018+0000","last_peered":"2024-09-17T03:13:39.196018+0000","last_clean":"2024-09-17T03:13:39.196018+0000","last_became_active":"2024-09-17T03:13:38.169083+0000","last_became_peered":"2024-09-17T03:13:38.169083+0000","last_unstale":"2024-09-17T03:13:39.196018+0000","last_undegraded":"2024-09-17T03:13:39.196018+0000","last_fullsized":"2024-09-17T03:13:39.196018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:53.571359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197904+0000","last_change":"2024-09-17T03:13:33.132790+0000","last_active":"2024-09-17T03:13:39.197904+0000","last_peered":"2024-09-17T03:13:39.197904+0000","last_clean":"2024-09-17T03:13:39.197904+0000","last_became_active":"2024-09-17T03:13:33.132482+0000","last_became_peered":"2024-09-17T03:13:33.132482+0000","last_unstale":"2024-09-17T03:13:39.197904+0000","last_undegraded":"2024-09-17T03:13:39.197904+0000","last_fullsized":"2024-09-17T03:13:39.197904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:36.557061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199238+0000","last_change":"2024-09-17T03:13:34.152246+0000","last_active":"2024-09-17T03:13:39.199238+0000","last_peered":"2024-09-17T03:13:39.199238+0000","last_clean":"2024-09-17T03:13:39.199238+0000","last_became_active":"2024-09-17T03:13:34.151761+0000","last_became_peered":"2024-09-17T03:13:34.151761+0000","last_unstale":"2024-09-17T03:13:39.199238+0000","last_undegraded":"2024-09-17T03:13:39.199238+0000","last_fullsized":"2024-09-17T03:13:39.199238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:55.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195385+0000","last_change":"2024-09-17T03:13:38.182362+0000","last_active":"2024-09-17T03:13:39.195385+0000","last_peered":"2024-09-17T03:13:39.195385+0000","last_clean":"2024-09-17T03:13:39.195385+0000","last_became_active":"2024-09-17T03:13:38.181949+0000","last_became_peered":"2024-09-17T03:13:38.181949+0000","last_unstale":"2024-09-17T03:13:39.195385+0000","last_undegraded":"2024-09-17T03:13:39.195385+0000","last_fullsized":"2024-09-17T03:13:39.195385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:21.583400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198556+0000","last_change":"2024-09-17T03:13:34.130957+0000","last_active":"2024-09-17T03:13:39.198556+0000","last_peered":"2024-09-17T03:13:39.198556+0000","last_clean":"2024-09-17T03:13:39.198556+0000","last_became_active":"2024-09-17T03:13:34.130643+0000","last_became_peered":"2024-09-17T03:13:34.130643+0000","last_unstale":"2024-09-17T03:13:39.198556+0000","last_undegraded":"2024-09-17T03:13:39.198556+0000","last_fullsized":"2024-09-17T03:13:39.198556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:30.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198915+0000","last_change":"2024-09-17T03:13:33.121803+0000","last_active":"2024-09-17T03:13:39.198915+0000","last_peered":"2024-09-17T03:13:39.198915+0000","last_clean":"2024-09-17T03:13:39.198915+0000","last_became_active":"2024-09-17T03:13:33.121396+0000","last_became_peered":"2024-09-17T03:13:33.121396+0000","last_unstale":"2024-09-17T03:13:39.198915+0000","last_undegraded":"2024-09-17T03:13:39.198915+0000","last_fullsized":"2024-09-17T03:13:39.198915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199170+0000","last_change":"2024-09-17T03:13:38.182273+0000","last_active":"2024-09-17T03:13:39.199170+0000","last_peered":"2024-09-17T03:13:39.199170+0000","last_clean":"2024-09-17T03:13:39.199170+0000","last_became_active":"2024-09-17T03:13:38.177607+0000","last_became_peered":"2024-09-17T03:13:38.177607+0000","last_unstale":"2024-09-17T03:13:39.199170+0000","last_undegraded":"2024-09-17T03:13:39.199170+0000","last_fullsized":"2024-09-17T03:13:39.199170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:00.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194949+0000","last_change":"2024-09-17T03:13:34.143115+0000","last_active":"2024-09-17T03:13:39.194949+0000","last_peered":"2024-09-17T03:13:39.194949+0000","last_clean":"2024-09-17T03:13:39.194949+0000","last_became_active":"2024-09-17T03:13:34.142792+0000","last_became_peered":"2024-09-17T03:13:34.142792+0000","last_unstale":"2024-09-17T03:13:39.194949+0000","last_undegraded":"2024-09-17T03:13:39.194949+0000","last_fullsized":"2024-09-17T03:13:39.194949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:16.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158223+0000","last_change":"2024-09-17T03:13:33.119000+0000","last_active":"2024-09-17T03:13:39.158223+0000","last_peered":"2024-09-17T03:13:39.158223+0000","last_clean":"2024-09-17T03:13:39.158223+0000","last_became_active":"2024-09-17T03:13:33.118137+0000","last_became_peered":"2024-09-17T03:13:33.118137+0000","last_unstale":"2024-09-17T03:13:39.158223+0000","last_undegraded":"2024-09-17T03:13:39.158223+0000","last_fullsized":"2024-09-17T03:13:39.158223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:48.663689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197652+0000","last_change":"2024-09-17T03:13:38.169936+0000","last_active":"2024-09-17T03:13:39.197652+0000","last_peered":"2024-09-17T03:13:39.197652+0000","last_clean":"2024-09-17T03:13:39.197652+0000","last_became_active":"2024-09-17T03:13:38.169497+0000","last_became_peered":"2024-09-17T03:13:38.169497+0000","last_unstale":"2024-09-17T03:13:39.197652+0000","last_undegraded":"2024-09-17T03:13:39.197652+0000","last_fullsized":"2024-09-17T03:13:39.197652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:41.815068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160080+0000","last_change":"2024-09-17T03:13:34.140522+0000","last_active":"2024-09-17T03:13:39.160080+0000","last_peered":"2024-09-17T03:13:39.160080+0000","last_clean":"2024-09-17T03:13:39.160080+0000","last_became_active":"2024-09-17T03:13:34.140149+0000","last_became_peered":"2024-09-17T03:13:34.140149+0000","last_unstale":"2024-09-17T03:13:39.160080+0000","last_undegraded":"2024-09-17T03:13:39.160080+0000","last_fullsized":"2024-09-17T03:13:39.160080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:16.959470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161158+0000","last_change":"2024-09-17T03:13:33.137244+0000","last_active":"2024-09-17T03:13:39.161158+0000","last_peered":"2024-09-17T03:13:39.161158+0000","last_clean":"2024-09-17T03:13:39.161158+0000","last_became_active":"2024-09-17T03:13:33.136903+0000","last_became_peered":"2024-09-17T03:13:33.136903+0000","last_unstale":"2024-09-17T03:13:39.161158+0000","last_undegraded":"2024-09-17T03:13:39.161158+0000","last_fullsized":"2024-09-17T03:13:39.161158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195505+0000","last_change":"2024-09-17T03:13:38.177994+0000","last_active":"2024-09-17T03:13:39.195505+0000","last_peered":"2024-09-17T03:13:39.195505+0000","last_clean":"2024-09-17T03:13:39.195505+0000","last_became_active":"2024-09-17T03:13:38.177478+0000","last_became_peered":"2024-09-17T03:13:38.177478+0000","last_unstale":"2024-09-17T03:13:39.195505+0000","last_undegraded":"2024-09-17T03:13:39.195505+0000","last_fullsized":"2024-09-17T03:13:39.195505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:12.414341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198055+0000","last_change":"2024-09-17T03:13:34.130179+0000","last_active":"2024-09-17T03:13:39.198055+0000","last_peered":"2024-09-17T03:13:39.198055+0000","last_clean":"2024-09-17T03:13:39.198055+0000","last_became_active":"2024-09-17T03:13:34.129884+0000","last_became_peered":"2024-09-17T03:13:34.129884+0000","last_unstale":"2024-09-17T03:13:39.198055+0000","last_undegraded":"2024-09-17T03:13:39.198055+0000","last_fullsized":"2024-09-17T03:13:39.198055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:50.196855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194458+0000","last_change":"2024-09-17T03:13:33.122054+0000","last_active":"2024-09-17T03:13:39.194458+0000","last_peered":"2024-09-17T03:13:39.194458+0000","last_clean":"2024-09-17T03:13:39.194458+0000","last_became_active":"2024-09-17T03:13:33.121698+0000","last_became_peered":"2024-09-17T03:13:33.121698+0000","last_unstale":"2024-09-17T03:13:39.194458+0000","last_undegraded":"2024-09-17T03:13:39.194458+0000","last_fullsized":"2024-09-17T03:13:39.194458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:57.578178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198044+0000","last_change":"2024-09-17T03:13:38.171631+0000","last_active":"2024-09-17T03:13:39.198044+0000","last_peered":"2024-09-17T03:13:39.198044+0000","last_clean":"2024-09-17T03:13:39.198044+0000","last_became_active":"2024-09-17T03:13:38.171240+0000","last_became_peered":"2024-09-17T03:13:38.171240+0000","last_unstale":"2024-09-17T03:13:39.198044+0000","last_undegraded":"2024-09-17T03:13:39.198044+0000","last_fullsized":"2024-09-17T03:13:39.198044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.719989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161020+0000","last_change":"2024-09-17T03:13:34.140177+0000","last_active":"2024-09-17T03:13:39.161020+0000","last_peered":"2024-09-17T03:13:39.161020+0000","last_clean":"2024-09-17T03:13:39.161020+0000","last_became_active":"2024-09-17T03:13:34.139841+0000","last_became_peered":"2024-09-17T03:13:34.139841+0000","last_unstale":"2024-09-17T03:13:39.161020+0000","last_undegraded":"2024-09-17T03:13:39.161020+0000","last_fullsized":"2024-09-17T03:13:39.161020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199584+0000","last_change":"2024-09-17T03:13:33.130507+0000","last_active":"2024-09-17T03:13:39.199584+0000","last_peered":"2024-09-17T03:13:39.199584+0000","last_clean":"2024-09-17T03:13:39.199584+0000","last_became_active":"2024-09-17T03:13:33.130209+0000","last_became_peered":"2024-09-17T03:13:33.130209+0000","last_unstale":"2024-09-17T03:13:39.199584+0000","last_undegraded":"2024-09-17T03:13:39.199584+0000","last_fullsized":"2024-09-17T03:13:39.199584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:15.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195482+0000","last_change":"2024-09-17T03:13:38.168304+0000","last_active":"2024-09-17T03:13:39.195482+0000","last_peered":"2024-09-17T03:13:39.195482+0000","last_clean":"2024-09-17T03:13:39.195482+0000","last_became_active":"2024-09-17T03:13:38.168009+0000","last_became_peered":"2024-09-17T03:13:38.168009+0000","last_unstale":"2024-09-17T03:13:39.195482+0000","last_undegraded":"2024-09-17T03:13:39.195482+0000","last_fullsized":"2024-09-17T03:13:39.195482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:37.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160808+0000","last_change":"2024-09-17T03:13:34.126671+0000","last_active":"2024-09-17T03:13:39.160808+0000","last_peered":"2024-09-17T03:13:39.160808+0000","last_clean":"2024-09-17T03:13:39.160808+0000","last_became_active":"2024-09-17T03:13:34.126376+0000","last_became_peered":"2024-09-17T03:13:34.126376+0000","last_unstale":"2024-09-17T03:13:39.160808+0000","last_undegraded":"2024-09-17T03:13:39.160808+0000","last_fullsized":"2024-09-17T03:13:39.160808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161109+0000","last_change":"2024-09-17T03:13:33.137148+0000","last_active":"2024-09-17T03:13:39.161109+0000","last_peered":"2024-09-17T03:13:39.161109+0000","last_clean":"2024-09-17T03:13:39.161109+0000","last_became_active":"2024-09-17T03:13:33.136897+0000","last_became_peered":"2024-09-17T03:13:33.136897+0000","last_unstale":"2024-09-17T03:13:39.161109+0000","last_undegraded":"2024-09-17T03:13:39.161109+0000","last_fullsized":"2024-09-17T03:13:39.161109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160118+0000","last_change":"2024-09-17T03:13:38.176096+0000","last_active":"2024-09-17T03:13:39.160118+0000","last_peered":"2024-09-17T03:13:39.160118+0000","last_clean":"2024-09-17T03:13:39.160118+0000","last_became_active":"2024-09-17T03:13:38.170721+0000","last_became_peered":"2024-09-17T03:13:38.170721+0000","last_unstale":"2024-09-17T03:13:39.160118+0000","last_undegraded":"2024-09-17T03:13:39.160118+0000","last_fullsized":"2024-09-17T03:13:39.160118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.067944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159455+0000","last_change":"2024-09-17T03:13:34.128263+0000","last_active":"2024-09-17T03:13:39.159455+0000","last_peered":"2024-09-17T03:13:39.159455+0000","last_clean":"2024-09-17T03:13:39.159455+0000","last_became_active":"2024-09-17T03:13:34.127855+0000","last_became_peered":"2024-09-17T03:13:34.127855+0000","last_unstale":"2024-09-17T03:13:39.159455+0000","last_undegraded":"2024-09-17T03:13:39.159455+0000","last_fullsized":"2024-09-17T03:13:39.159455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:48.610659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199587+0000","last_change":"2024-09-17T03:13:33.119090+0000","last_active":"2024-09-17T03:13:39.199587+0000","last_peered":"2024-09-17T03:13:39.199587+0000","last_clean":"2024-09-17T03:13:39.199587+0000","last_became_active":"2024-09-17T03:13:33.118370+0000","last_became_peered":"2024-09-17T03:13:33.118370+0000","last_unstale":"2024-09-17T03:13:39.199587+0000","last_undegraded":"2024-09-17T03:13:39.199587+0000","last_fullsized":"2024-09-17T03:13:39.199587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:40.438813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158397+0000","last_change":"2024-09-17T03:13:38.170311+0000","last_active":"2024-09-17T03:13:39.158397+0000","last_peered":"2024-09-17T03:13:39.158397+0000","last_clean":"2024-09-17T03:13:39.158397+0000","last_became_active":"2024-09-17T03:13:38.169794+0000","last_became_peered":"2024-09-17T03:13:38.169794+0000","last_unstale":"2024-09-17T03:13:39.158397+0000","last_undegraded":"2024-09-17T03:13:39.158397+0000","last_fullsized":"2024-09-17T03:13:39.158397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:47.182972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196860+0000","last_change":"2024-09-17T03:13:34.123331+0000","last_active":"2024-09-17T03:13:39.196860+0000","last_peered":"2024-09-17T03:13:39.196860+0000","last_clean":"2024-09-17T03:13:39.196860+0000","last_became_active":"2024-09-17T03:13:34.120225+0000","last_became_peered":"2024-09-17T03:13:34.120225+0000","last_unstale":"2024-09-17T03:13:39.196860+0000","last_undegraded":"2024-09-17T03:13:39.196860+0000","last_fullsized":"2024-09-17T03:13:39.196860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:15.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158326+0000","last_change":"2024-09-17T03:13:33.128407+0000","last_active":"2024-09-17T03:13:39.158326+0000","last_peered":"2024-09-17T03:13:39.158326+0000","last_clean":"2024-09-17T03:13:39.158326+0000","last_became_active":"2024-09-17T03:13:33.128078+0000","last_became_peered":"2024-09-17T03:13:33.128078+0000","last_unstale":"2024-09-17T03:13:39.158326+0000","last_undegraded":"2024-09-17T03:13:39.158326+0000","last_fullsized":"2024-09-17T03:13:39.158326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157547+0000","last_change":"2024-09-17T03:13:38.170011+0000","last_active":"2024-09-17T03:13:39.157547+0000","last_peered":"2024-09-17T03:13:39.157547+0000","last_clean":"2024-09-17T03:13:39.157547+0000","last_became_active":"2024-09-17T03:13:38.169510+0000","last_became_peered":"2024-09-17T03:13:38.169510+0000","last_unstale":"2024-09-17T03:13:39.157547+0000","last_undegraded":"2024-09-17T03:13:39.157547+0000","last_fullsized":"2024-09-17T03:13:39.157547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:32.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196289+0000","last_change":"2024-09-17T03:13:34.150966+0000","last_active":"2024-09-17T03:13:39.196289+0000","last_peered":"2024-09-17T03:13:39.196289+0000","last_clean":"2024-09-17T03:13:39.196289+0000","last_became_active":"2024-09-17T03:13:34.150654+0000","last_became_peered":"2024-09-17T03:13:34.150654+0000","last_unstale":"2024-09-17T03:13:39.196289+0000","last_undegraded":"2024-09-17T03:13:39.196289+0000","last_fullsized":"2024-09-17T03:13:39.196289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:41.752422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198782+0000","last_change":"2024-09-17T03:13:33.125357+0000","last_active":"2024-09-17T03:13:39.198782+0000","last_peered":"2024-09-17T03:13:39.198782+0000","last_clean":"2024-09-17T03:13:39.198782+0000","last_became_active":"2024-09-17T03:13:33.124855+0000","last_became_peered":"2024-09-17T03:13:33.124855+0000","last_unstale":"2024-09-17T03:13:39.198782+0000","last_undegraded":"2024-09-17T03:13:39.198782+0000","last_fullsized":"2024-09-17T03:13:39.198782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.725350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159207+0000","last_change":"2024-09-17T03:13:38.174646+0000","last_active":"2024-09-17T03:13:39.159207+0000","last_peered":"2024-09-17T03:13:39.159207+0000","last_clean":"2024-09-17T03:13:39.159207+0000","last_became_active":"2024-09-17T03:13:38.172014+0000","last_became_peered":"2024-09-17T03:13:38.172014+0000","last_unstale":"2024-09-17T03:13:39.159207+0000","last_undegraded":"2024-09-17T03:13:39.159207+0000","last_fullsized":"2024-09-17T03:13:39.159207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:00.671761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157242+0000","last_change":"2024-09-17T03:13:34.139654+0000","last_active":"2024-09-17T03:13:39.157242+0000","last_peered":"2024-09-17T03:13:39.157242+0000","last_clean":"2024-09-17T03:13:39.157242+0000","last_became_active":"2024-09-17T03:13:34.139302+0000","last_became_peered":"2024-09-17T03:13:34.139302+0000","last_unstale":"2024-09-17T03:13:39.157242+0000","last_undegraded":"2024-09-17T03:13:39.157242+0000","last_fullsized":"2024-09-17T03:13:39.157242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:17.544789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194921+0000","last_change":"2024-09-17T03:13:33.125260+0000","last_active":"2024-09-17T03:13:39.194921+0000","last_peered":"2024-09-17T03:13:39.194921+0000","last_clean":"2024-09-17T03:13:39.194921+0000","last_became_active":"2024-09-17T03:13:33.124837+0000","last_became_peered":"2024-09-17T03:13:33.124837+0000","last_unstale":"2024-09-17T03:13:39.194921+0000","last_undegraded":"2024-09-17T03:13:39.194921+0000","last_fullsized":"2024-09-17T03:13:39.194921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:23.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159089+0000","last_change":"2024-09-17T03:13:38.182098+0000","last_active":"2024-09-17T03:13:39.159089+0000","last_peered":"2024-09-17T03:13:39.159089+0000","last_clean":"2024-09-17T03:13:39.159089+0000","last_became_active":"2024-09-17T03:13:38.181677+0000","last_became_peered":"2024-09-17T03:13:38.181677+0000","last_unstale":"2024-09-17T03:13:39.159089+0000","last_undegraded":"2024-09-17T03:13:39.159089+0000","last_fullsized":"2024-09-17T03:13:39.159089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.122052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157898+0000","last_change":"2024-09-17T03:13:34.137074+0000","last_active":"2024-09-17T03:13:39.157898+0000","last_peered":"2024-09-17T03:13:39.157898+0000","last_clean":"2024-09-17T03:13:39.157898+0000","last_became_active":"2024-09-17T03:13:34.133966+0000","last_became_peered":"2024-09-17T03:13:34.133966+0000","last_unstale":"2024-09-17T03:13:39.157898+0000","last_undegraded":"2024-09-17T03:13:39.157898+0000","last_fullsized":"2024-09-17T03:13:39.157898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196689+0000","last_change":"2024-09-17T03:13:33.126182+0000","last_active":"2024-09-17T03:13:39.196689+0000","last_peered":"2024-09-17T03:13:39.196689+0000","last_clean":"2024-09-17T03:13:39.196689+0000","last_became_active":"2024-09-17T03:13:33.121972+0000","last_became_peered":"2024-09-17T03:13:33.121972+0000","last_unstale":"2024-09-17T03:13:39.196689+0000","last_undegraded":"2024-09-17T03:13:39.196689+0000","last_fullsized":"2024-09-17T03:13:39.196689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:42.270063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159179+0000","last_change":"2024-09-17T03:13:38.168583+0000","last_active":"2024-09-17T03:13:39.159179+0000","last_peered":"2024-09-17T03:13:39.159179+0000","last_clean":"2024-09-17T03:13:39.159179+0000","last_became_active":"2024-09-17T03:13:38.168090+0000","last_became_peered":"2024-09-17T03:13:38.168090+0000","last_unstale":"2024-09-17T03:13:39.159179+0000","last_undegraded":"2024-09-17T03:13:39.159179+0000","last_fullsized":"2024-09-17T03:13:39.159179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:54.235466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160787+0000","last_change":"2024-09-17T03:13:34.112239+0000","last_active":"2024-09-17T03:13:39.160787+0000","last_peered":"2024-09-17T03:13:39.160787+0000","last_clean":"2024-09-17T03:13:39.160787+0000","last_became_active":"2024-09-17T03:13:34.111911+0000","last_became_peered":"2024-09-17T03:13:34.111911+0000","last_unstale":"2024-09-17T03:13:39.160787+0000","last_undegraded":"2024-09-17T03:13:39.160787+0000","last_fullsized":"2024-09-17T03:13:39.160787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:08.503088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198916+0000","last_change":"2024-09-17T03:13:33.125715+0000","last_active":"2024-09-17T03:13:39.198916+0000","last_peered":"2024-09-17T03:13:39.198916+0000","last_clean":"2024-09-17T03:13:39.198916+0000","last_became_active":"2024-09-17T03:13:33.125194+0000","last_became_peered":"2024-09-17T03:13:33.125194+0000","last_unstale":"2024-09-17T03:13:39.198916+0000","last_undegraded":"2024-09-17T03:13:39.198916+0000","last_fullsized":"2024-09-17T03:13:39.198916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:19.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196858+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:13:39.196858+0000","last_peered":"2024-09-17T03:13:39.196858+0000","last_clean":"2024-09-17T03:13:39.196858+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:13:39.196858+0000","last_undegraded":"2024-09-17T03:13:39.196858+0000","last_fullsized":"2024-09-17T03:13:39.196858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199547+0000","last_change":"2024-09-17T03:13:38.167682+0000","last_active":"2024-09-17T03:13:39.199547+0000","last_peered":"2024-09-17T03:13:39.199547+0000","last_clean":"2024-09-17T03:13:39.199547+0000","last_became_active":"2024-09-17T03:13:38.167110+0000","last_became_peered":"2024-09-17T03:13:38.167110+0000","last_unstale":"2024-09-17T03:13:39.199547+0000","last_undegraded":"2024-09-17T03:13:39.199547+0000","last_fullsized":"2024-09-17T03:13:39.199547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:12.466588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199361+0000","last_change":"2024-09-17T03:13:34.131142+0000","last_active":"2024-09-17T03:13:39.199361+0000","last_peered":"2024-09-17T03:13:39.199361+0000","last_clean":"2024-09-17T03:13:39.199361+0000","last_became_active":"2024-09-17T03:13:34.130839+0000","last_became_peered":"2024-09-17T03:13:34.130839+0000","last_unstale":"2024-09-17T03:13:39.199361+0000","last_undegraded":"2024-09-17T03:13:39.199361+0000","last_fullsized":"2024-09-17T03:13:39.199361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:37.776457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159474+0000","last_change":"2024-09-17T03:13:33.133189+0000","last_active":"2024-09-17T03:13:39.159474+0000","last_peered":"2024-09-17T03:13:39.159474+0000","last_clean":"2024-09-17T03:13:39.159474+0000","last_became_active":"2024-09-17T03:13:33.132836+0000","last_became_peered":"2024-09-17T03:13:33.132836+0000","last_unstale":"2024-09-17T03:13:39.159474+0000","last_undegraded":"2024-09-17T03:13:39.159474+0000","last_fullsized":"2024-09-17T03:13:39.159474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:51.274515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196215+0000","last_change":"2024-09-17T03:13:38.183375+0000","last_active":"2024-09-17T03:13:39.196215+0000","last_peered":"2024-09-17T03:13:39.196215+0000","last_clean":"2024-09-17T03:13:39.196215+0000","last_became_active":"2024-09-17T03:13:38.182947+0000","last_became_peered":"2024-09-17T03:13:38.182947+0000","last_unstale":"2024-09-17T03:13:39.196215+0000","last_undegraded":"2024-09-17T03:13:39.196215+0000","last_fullsized":"2024-09-17T03:13:39.196215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.792778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197849+0000","last_change":"2024-09-17T03:13:34.142680+0000","last_active":"2024-09-17T03:13:39.197849+0000","last_peered":"2024-09-17T03:13:39.197849+0000","last_clean":"2024-09-17T03:13:39.197849+0000","last_became_active":"2024-09-17T03:13:34.142375+0000","last_became_peered":"2024-09-17T03:13:34.142375+0000","last_unstale":"2024-09-17T03:13:39.197849+0000","last_undegraded":"2024-09-17T03:13:39.197849+0000","last_fullsized":"2024-09-17T03:13:39.197849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160135+0000","last_change":"2024-09-17T03:13:33.121940+0000","last_active":"2024-09-17T03:13:39.160135+0000","last_peered":"2024-09-17T03:13:39.160135+0000","last_clean":"2024-09-17T03:13:39.160135+0000","last_became_active":"2024-09-17T03:13:33.121454+0000","last_became_peered":"2024-09-17T03:13:33.121454+0000","last_unstale":"2024-09-17T03:13:39.160135+0000","last_undegraded":"2024-09-17T03:13:39.160135+0000","last_fullsized":"2024-09-17T03:13:39.160135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158537+0000","last_change":"2024-09-17T03:13:38.175006+0000","last_active":"2024-09-17T03:13:39.158537+0000","last_peered":"2024-09-17T03:13:39.158537+0000","last_clean":"2024-09-17T03:13:39.158537+0000","last_became_active":"2024-09-17T03:13:38.174354+0000","last_became_peered":"2024-09-17T03:13:38.174354+0000","last_unstale":"2024-09-17T03:13:39.158537+0000","last_undegraded":"2024-09-17T03:13:39.158537+0000","last_fullsized":"2024-09-17T03:13:39.158537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:46.350871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198197+0000","last_change":"2024-09-17T03:13:34.134217+0000","last_active":"2024-09-17T03:13:39.198197+0000","last_peered":"2024-09-17T03:13:39.198197+0000","last_clean":"2024-09-17T03:13:39.198197+0000","last_became_active":"2024-09-17T03:13:34.133864+0000","last_became_peered":"2024-09-17T03:13:34.133864+0000","last_unstale":"2024-09-17T03:13:39.198197+0000","last_undegraded":"2024-09-17T03:13:39.198197+0000","last_fullsized":"2024-09-17T03:13:39.198197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.172692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160941+0000","last_change":"2024-09-17T03:13:33.126989+0000","last_active":"2024-09-17T03:13:39.160941+0000","last_peered":"2024-09-17T03:13:39.160941+0000","last_clean":"2024-09-17T03:13:39.160941+0000","last_became_active":"2024-09-17T03:13:33.126662+0000","last_became_peered":"2024-09-17T03:13:33.126662+0000","last_unstale":"2024-09-17T03:13:39.160941+0000","last_undegraded":"2024-09-17T03:13:39.160941+0000","last_fullsized":"2024-09-17T03:13:39.160941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196440+0000","last_change":"2024-09-17T03:13:38.171271+0000","last_active":"2024-09-17T03:13:39.196440+0000","last_peered":"2024-09-17T03:13:39.196440+0000","last_clean":"2024-09-17T03:13:39.196440+0000","last_became_active":"2024-09-17T03:13:38.170206+0000","last_became_peered":"2024-09-17T03:13:38.170206+0000","last_unstale":"2024-09-17T03:13:39.196440+0000","last_undegraded":"2024-09-17T03:13:39.196440+0000","last_fullsized":"2024-09-17T03:13:39.196440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.198605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197293+0000","last_change":"2024-09-17T03:13:34.140674+0000","last_active":"2024-09-17T03:13:39.197293+0000","last_peered":"2024-09-17T03:13:39.197293+0000","last_clean":"2024-09-17T03:13:39.197293+0000","last_became_active":"2024-09-17T03:13:34.140286+0000","last_became_peered":"2024-09-17T03:13:34.140286+0000","last_unstale":"2024-09-17T03:13:39.197293+0000","last_undegraded":"2024-09-17T03:13:39.197293+0000","last_fullsized":"2024-09-17T03:13:39.197293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:16.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198435+0000","last_change":"2024-09-17T03:13:33.129963+0000","last_active":"2024-09-17T03:13:39.198435+0000","last_peered":"2024-09-17T03:13:39.198435+0000","last_clean":"2024-09-17T03:13:39.198435+0000","last_became_active":"2024-09-17T03:13:33.128743+0000","last_became_peered":"2024-09-17T03:13:33.128743+0000","last_unstale":"2024-09-17T03:13:39.198435+0000","last_undegraded":"2024-09-17T03:13:39.198435+0000","last_fullsized":"2024-09-17T03:13:39.198435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:59.444297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195666+0000","last_change":"2024-09-17T03:13:38.174410+0000","last_active":"2024-09-17T03:13:39.195666+0000","last_peered":"2024-09-17T03:13:39.195666+0000","last_clean":"2024-09-17T03:13:39.195666+0000","last_became_active":"2024-09-17T03:13:38.168524+0000","last_became_peered":"2024-09-17T03:13:38.168524+0000","last_unstale":"2024-09-17T03:13:39.195666+0000","last_undegraded":"2024-09-17T03:13:39.195666+0000","last_fullsized":"2024-09-17T03:13:39.195666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:11.387448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198030+0000","last_change":"2024-09-17T03:13:34.129876+0000","last_active":"2024-09-17T03:13:39.198030+0000","last_peered":"2024-09-17T03:13:39.198030+0000","last_clean":"2024-09-17T03:13:39.198030+0000","last_became_active":"2024-09-17T03:13:34.128110+0000","last_became_peered":"2024-09-17T03:13:34.128110+0000","last_unstale":"2024-09-17T03:13:39.198030+0000","last_undegraded":"2024-09-17T03:13:39.198030+0000","last_fullsized":"2024-09-17T03:13:39.198030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:04.560173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160218+0000","last_change":"2024-09-17T03:13:33.125002+0000","last_active":"2024-09-17T03:13:39.160218+0000","last_peered":"2024-09-17T03:13:39.160218+0000","last_clean":"2024-09-17T03:13:39.160218+0000","last_became_active":"2024-09-17T03:13:33.124643+0000","last_became_peered":"2024-09-17T03:13:33.124643+0000","last_unstale":"2024-09-17T03:13:39.160218+0000","last_undegraded":"2024-09-17T03:13:39.160218+0000","last_fullsized":"2024-09-17T03:13:39.160218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159507+0000","last_change":"2024-09-17T03:13:38.171833+0000","last_active":"2024-09-17T03:13:39.159507+0000","last_peered":"2024-09-17T03:13:39.159507+0000","last_clean":"2024-09-17T03:13:39.159507+0000","last_became_active":"2024-09-17T03:13:38.171380+0000","last_became_peered":"2024-09-17T03:13:38.171380+0000","last_unstale":"2024-09-17T03:13:39.159507+0000","last_undegraded":"2024-09-17T03:13:39.159507+0000","last_fullsized":"2024-09-17T03:13:39.159507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:43.248158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196746+0000","last_change":"2024-09-17T03:13:34.127390+0000","last_active":"2024-09-17T03:13:39.196746+0000","last_peered":"2024-09-17T03:13:39.196746+0000","last_clean":"2024-09-17T03:13:39.196746+0000","last_became_active":"2024-09-17T03:13:34.126867+0000","last_became_peered":"2024-09-17T03:13:34.126867+0000","last_unstale":"2024-09-17T03:13:39.196746+0000","last_undegraded":"2024-09-17T03:13:39.196746+0000","last_fullsized":"2024-09-17T03:13:39.196746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:45.924771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195084+0000","last_change":"2024-09-17T03:13:33.134673+0000","last_active":"2024-09-17T03:13:39.195084+0000","last_peered":"2024-09-17T03:13:39.195084+0000","last_clean":"2024-09-17T03:13:39.195084+0000","last_became_active":"2024-09-17T03:13:33.134335+0000","last_became_peered":"2024-09-17T03:13:33.134335+0000","last_unstale":"2024-09-17T03:13:39.195084+0000","last_undegraded":"2024-09-17T03:13:39.195084+0000","last_fullsized":"2024-09-17T03:13:39.195084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:19.536470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159940+0000","last_change":"2024-09-17T03:13:38.170527+0000","last_active":"2024-09-17T03:13:39.159940+0000","last_peered":"2024-09-17T03:13:39.159940+0000","last_clean":"2024-09-17T03:13:39.159940+0000","last_became_active":"2024-09-17T03:13:38.170114+0000","last_became_peered":"2024-09-17T03:13:38.170114+0000","last_unstale":"2024-09-17T03:13:39.159940+0000","last_undegraded":"2024-09-17T03:13:39.159940+0000","last_fullsized":"2024-09-17T03:13:39.159940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.118342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197562+0000","last_change":"2024-09-17T03:13:34.145344+0000","last_active":"2024-09-17T03:13:39.197562+0000","last_peered":"2024-09-17T03:13:39.197562+0000","last_clean":"2024-09-17T03:13:39.197562+0000","last_became_active":"2024-09-17T03:13:34.145041+0000","last_became_peered":"2024-09-17T03:13:34.145041+0000","last_unstale":"2024-09-17T03:13:39.197562+0000","last_undegraded":"2024-09-17T03:13:39.197562+0000","last_fullsized":"2024-09-17T03:13:39.197562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:42.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198728+0000","last_change":"2024-09-17T03:13:33.125668+0000","last_active":"2024-09-17T03:13:39.198728+0000","last_peered":"2024-09-17T03:13:39.198728+0000","last_clean":"2024-09-17T03:13:39.198728+0000","last_became_active":"2024-09-17T03:13:33.125357+0000","last_became_peered":"2024-09-17T03:13:33.125357+0000","last_unstale":"2024-09-17T03:13:39.198728+0000","last_undegraded":"2024-09-17T03:13:39.198728+0000","last_fullsized":"2024-09-17T03:13:39.198728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.692949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159384+0000","last_change":"2024-09-17T03:13:38.174239+0000","last_active":"2024-09-17T03:13:39.159384+0000","last_peered":"2024-09-17T03:13:39.159384+0000","last_clean":"2024-09-17T03:13:39.159384+0000","last_became_active":"2024-09-17T03:13:38.171412+0000","last_became_peered":"2024-09-17T03:13:38.171412+0000","last_unstale":"2024-09-17T03:13:39.159384+0000","last_undegraded":"2024-09-17T03:13:39.159384+0000","last_fullsized":"2024-09-17T03:13:39.159384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:06.888462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157843+0000","last_change":"2024-09-17T03:13:34.125801+0000","last_active":"2024-09-17T03:13:39.157843+0000","last_peered":"2024-09-17T03:13:39.157843+0000","last_clean":"2024-09-17T03:13:39.157843+0000","last_became_active":"2024-09-17T03:13:34.125205+0000","last_became_peered":"2024-09-17T03:13:34.125205+0000","last_unstale":"2024-09-17T03:13:39.157843+0000","last_undegraded":"2024-09-17T03:13:39.157843+0000","last_fullsized":"2024-09-17T03:13:39.157843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195177+0000","last_change":"2024-09-17T03:13:33.139264+0000","last_active":"2024-09-17T03:13:39.195177+0000","last_peered":"2024-09-17T03:13:39.195177+0000","last_clean":"2024-09-17T03:13:39.195177+0000","last_became_active":"2024-09-17T03:13:33.138945+0000","last_became_peered":"2024-09-17T03:13:33.138945+0000","last_unstale":"2024-09-17T03:13:39.195177+0000","last_undegraded":"2024-09-17T03:13:39.195177+0000","last_fullsized":"2024-09-17T03:13:39.195177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:06.266580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199260+0000","last_change":"2024-09-17T03:13:38.179790+0000","last_active":"2024-09-17T03:13:39.199260+0000","last_peered":"2024-09-17T03:13:39.199260+0000","last_clean":"2024-09-17T03:13:39.199260+0000","last_became_active":"2024-09-17T03:13:38.176965+0000","last_became_peered":"2024-09-17T03:13:38.176965+0000","last_unstale":"2024-09-17T03:13:39.199260+0000","last_undegraded":"2024-09-17T03:13:39.199260+0000","last_fullsized":"2024-09-17T03:13:39.199260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.524936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197505+0000","last_change":"2024-09-17T03:13:34.150718+0000","last_active":"2024-09-17T03:13:39.197505+0000","last_peered":"2024-09-17T03:13:39.197505+0000","last_clean":"2024-09-17T03:13:39.197505+0000","last_became_active":"2024-09-17T03:13:34.150380+0000","last_became_peered":"2024-09-17T03:13:34.150380+0000","last_unstale":"2024-09-17T03:13:39.197505+0000","last_undegraded":"2024-09-17T03:13:39.197505+0000","last_fullsized":"2024-09-17T03:13:39.197505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:45.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:47.064052+0000","last_change":"2024-09-17T03:13:33.115018+0000","last_active":"2024-09-17T03:13:47.064052+0000","last_peered":"2024-09-17T03:13:47.064052+0000","last_clean":"2024-09-17T03:13:47.064052+0000","last_became_active":"2024-09-17T03:13:33.114688+0000","last_became_peered":"2024-09-17T03:13:33.114688+0000","last_unstale":"2024-09-17T03:13:47.064052+0000","last_undegraded":"2024-09-17T03:13:47.064052+0000","last_fullsized":"2024-09-17T03:13:47.064052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.942641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160669+0000","last_change":"2024-09-17T03:13:38.175179+0000","last_active":"2024-09-17T03:13:39.160669+0000","last_peered":"2024-09-17T03:13:39.160669+0000","last_clean":"2024-09-17T03:13:39.160669+0000","last_became_active":"2024-09-17T03:13:38.172867+0000","last_became_peered":"2024-09-17T03:13:38.172867+0000","last_unstale":"2024-09-17T03:13:39.160669+0000","last_undegraded":"2024-09-17T03:13:39.160669+0000","last_fullsized":"2024-09-17T03:13:39.160669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:37.361119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199202+0000","last_change":"2024-09-17T03:13:34.124140+0000","last_active":"2024-09-17T03:13:39.199202+0000","last_peered":"2024-09-17T03:13:39.199202+0000","last_clean":"2024-09-17T03:13:39.199202+0000","last_became_active":"2024-09-17T03:13:34.123830+0000","last_became_peered":"2024-09-17T03:13:34.123830+0000","last_unstale":"2024-09-17T03:13:39.199202+0000","last_undegraded":"2024-09-17T03:13:39.199202+0000","last_fullsized":"2024-09-17T03:13:39.199202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:33.119048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195209+0000","last_change":"2024-09-17T03:13:33.132508+0000","last_active":"2024-09-17T03:13:39.195209+0000","last_peered":"2024-09-17T03:13:39.195209+0000","last_clean":"2024-09-17T03:13:39.195209+0000","last_became_active":"2024-09-17T03:13:33.132171+0000","last_became_peered":"2024-09-17T03:13:33.132171+0000","last_unstale":"2024-09-17T03:13:39.195209+0000","last_undegraded":"2024-09-17T03:13:39.195209+0000","last_fullsized":"2024-09-17T03:13:39.195209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:24.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196268+0000","last_change":"2024-09-17T03:13:38.170462+0000","last_active":"2024-09-17T03:13:39.196268+0000","last_peered":"2024-09-17T03:13:39.196268+0000","last_clean":"2024-09-17T03:13:39.196268+0000","last_became_active":"2024-09-17T03:13:38.169604+0000","last_became_peered":"2024-09-17T03:13:38.169604+0000","last_unstale":"2024-09-17T03:13:39.196268+0000","last_undegraded":"2024-09-17T03:13:39.196268+0000","last_fullsized":"2024-09-17T03:13:39.196268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:40.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160025+0000","last_change":"2024-09-17T03:13:34.128238+0000","last_active":"2024-09-17T03:13:39.160025+0000","last_peered":"2024-09-17T03:13:39.160025+0000","last_clean":"2024-09-17T03:13:39.160025+0000","last_became_active":"2024-09-17T03:13:34.127900+0000","last_became_peered":"2024-09-17T03:13:34.127900+0000","last_unstale":"2024-09-17T03:13:39.160025+0000","last_undegraded":"2024-09-17T03:13:39.160025+0000","last_fullsized":"2024-09-17T03:13:39.160025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197209+0000","last_change":"2024-09-17T03:13:33.133386+0000","last_active":"2024-09-17T03:13:39.197209+0000","last_peered":"2024-09-17T03:13:39.197209+0000","last_clean":"2024-09-17T03:13:39.197209+0000","last_became_active":"2024-09-17T03:13:33.132496+0000","last_became_peered":"2024-09-17T03:13:33.132496+0000","last_unstale":"2024-09-17T03:13:39.197209+0000","last_undegraded":"2024-09-17T03:13:39.197209+0000","last_fullsized":"2024-09-17T03:13:39.197209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:53.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194730+0000","last_change":"2024-09-17T03:13:38.176141+0000","last_active":"2024-09-17T03:13:39.194730+0000","last_peered":"2024-09-17T03:13:39.194730+0000","last_clean":"2024-09-17T03:13:39.194730+0000","last_became_active":"2024-09-17T03:13:38.175441+0000","last_became_peered":"2024-09-17T03:13:38.175441+0000","last_unstale":"2024-09-17T03:13:39.194730+0000","last_undegraded":"2024-09-17T03:13:39.194730+0000","last_fullsized":"2024-09-17T03:13:39.194730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:24.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197192+0000","last_change":"2024-09-17T03:13:34.127326+0000","last_active":"2024-09-17T03:13:39.197192+0000","last_peered":"2024-09-17T03:13:39.197192+0000","last_clean":"2024-09-17T03:13:39.197192+0000","last_became_active":"2024-09-17T03:13:34.126960+0000","last_became_peered":"2024-09-17T03:13:34.126960+0000","last_unstale":"2024-09-17T03:13:39.197192+0000","last_undegraded":"2024-09-17T03:13:39.197192+0000","last_fullsized":"2024-09-17T03:13:39.197192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:05.699702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197544+0000","last_change":"2024-09-17T03:13:33.127320+0000","last_active":"2024-09-17T03:13:39.197544+0000","last_peered":"2024-09-17T03:13:39.197544+0000","last_clean":"2024-09-17T03:13:39.197544+0000","last_became_active":"2024-09-17T03:13:33.126979+0000","last_became_peered":"2024-09-17T03:13:33.126979+0000","last_unstale":"2024-09-17T03:13:39.197544+0000","last_undegraded":"2024-09-17T03:13:39.197544+0000","last_fullsized":"2024-09-17T03:13:39.197544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160474+0000","last_change":"2024-09-17T03:13:38.170474+0000","last_active":"2024-09-17T03:13:39.160474+0000","last_peered":"2024-09-17T03:13:39.160474+0000","last_clean":"2024-09-17T03:13:39.160474+0000","last_became_active":"2024-09-17T03:13:38.169227+0000","last_became_peered":"2024-09-17T03:13:38.169227+0000","last_unstale":"2024-09-17T03:13:39.160474+0000","last_undegraded":"2024-09-17T03:13:39.160474+0000","last_fullsized":"2024-09-17T03:13:39.160474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:39.513902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160847+0000","last_change":"2024-09-17T03:13:38.173752+0000","last_active":"2024-09-17T03:13:39.160847+0000","last_peered":"2024-09-17T03:13:39.160847+0000","last_clean":"2024-09-17T03:13:39.160847+0000","last_became_active":"2024-09-17T03:13:38.173339+0000","last_became_peered":"2024-09-17T03:13:38.173339+0000","last_unstale":"2024-09-17T03:13:39.160847+0000","last_undegraded":"2024-09-17T03:13:39.160847+0000","last_fullsized":"2024-09-17T03:13:39.160847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:49.042265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161197+0000","last_change":"2024-09-17T03:13:34.128858+0000","last_active":"2024-09-17T03:13:39.161197+0000","last_peered":"2024-09-17T03:13:39.161197+0000","last_clean":"2024-09-17T03:13:39.161197+0000","last_became_active":"2024-09-17T03:13:34.128470+0000","last_became_peered":"2024-09-17T03:13:34.128470+0000","last_unstale":"2024-09-17T03:13:39.161197+0000","last_undegraded":"2024-09-17T03:13:39.161197+0000","last_fullsized":"2024-09-17T03:13:39.161197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:20.842323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196620+0000","last_change":"2024-09-17T03:13:33.123650+0000","last_active":"2024-09-17T03:13:39.196620+0000","last_peered":"2024-09-17T03:13:39.196620+0000","last_clean":"2024-09-17T03:13:39.196620+0000","last_became_active":"2024-09-17T03:13:33.123336+0000","last_became_peered":"2024-09-17T03:13:33.123336+0000","last_unstale":"2024-09-17T03:13:39.196620+0000","last_undegraded":"2024-09-17T03:13:39.196620+0000","last_fullsized":"2024-09-17T03:13:39.196620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:22.478021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199452+0000","last_change":"2024-09-17T03:13:38.186350+0000","last_active":"2024-09-17T03:13:39.199452+0000","last_peered":"2024-09-17T03:13:39.199452+0000","last_clean":"2024-09-17T03:13:39.199452+0000","last_became_active":"2024-09-17T03:13:38.185605+0000","last_became_peered":"2024-09-17T03:13:38.185605+0000","last_unstale":"2024-09-17T03:13:39.199452+0000","last_undegraded":"2024-09-17T03:13:39.199452+0000","last_fullsized":"2024-09-17T03:13:39.199452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:12.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157345+0000","last_change":"2024-09-17T03:13:34.125368+0000","last_active":"2024-09-17T03:13:39.157345+0000","last_peered":"2024-09-17T03:13:39.157345+0000","last_clean":"2024-09-17T03:13:39.157345+0000","last_became_active":"2024-09-17T03:13:34.124883+0000","last_became_peered":"2024-09-17T03:13:34.124883+0000","last_unstale":"2024-09-17T03:13:39.157345+0000","last_undegraded":"2024-09-17T03:13:39.157345+0000","last_fullsized":"2024-09-17T03:13:39.157345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158046+0000","last_change":"2024-09-17T03:13:33.128441+0000","last_active":"2024-09-17T03:13:39.158046+0000","last_peered":"2024-09-17T03:13:39.158046+0000","last_clean":"2024-09-17T03:13:39.158046+0000","last_became_active":"2024-09-17T03:13:33.128152+0000","last_became_peered":"2024-09-17T03:13:33.128152+0000","last_unstale":"2024-09-17T03:13:39.158046+0000","last_undegraded":"2024-09-17T03:13:39.158046+0000","last_fullsized":"2024-09-17T03:13:39.158046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:06.006592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198671+0000","last_change":"2024-09-17T03:13:33.128570+0000","last_active":"2024-09-17T03:13:39.198671+0000","last_peered":"2024-09-17T03:13:39.198671+0000","last_clean":"2024-09-17T03:13:39.198671+0000","last_became_active":"2024-09-17T03:13:33.128178+0000","last_became_peered":"2024-09-17T03:13:33.128178+0000","last_unstale":"2024-09-17T03:13:39.198671+0000","last_undegraded":"2024-09-17T03:13:39.198671+0000","last_fullsized":"2024-09-17T03:13:39.198671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.359407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160314+0000","last_change":"2024-09-17T03:13:34.136349+0000","last_active":"2024-09-17T03:13:39.160314+0000","last_peered":"2024-09-17T03:13:39.160314+0000","last_clean":"2024-09-17T03:13:39.160314+0000","last_became_active":"2024-09-17T03:13:34.135978+0000","last_became_peered":"2024-09-17T03:13:34.135978+0000","last_unstale":"2024-09-17T03:13:39.160314+0000","last_undegraded":"2024-09-17T03:13:39.160314+0000","last_fullsized":"2024-09-17T03:13:39.160314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:08.375730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161237+0000","last_change":"2024-09-17T03:13:38.179343+0000","last_active":"2024-09-17T03:13:39.161237+0000","last_peered":"2024-09-17T03:13:39.161237+0000","last_clean":"2024-09-17T03:13:39.161237+0000","last_became_active":"2024-09-17T03:13:38.178868+0000","last_became_peered":"2024-09-17T03:13:38.178868+0000","last_unstale":"2024-09-17T03:13:39.161237+0000","last_undegraded":"2024-09-17T03:13:39.161237+0000","last_fullsized":"2024-09-17T03:13:39.161237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:58.731297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158741+0000","last_change":"2024-09-17T03:13:33.126321+0000","last_active":"2024-09-17T03:13:39.158741+0000","last_peered":"2024-09-17T03:13:39.158741+0000","last_clean":"2024-09-17T03:13:39.158741+0000","last_became_active":"2024-09-17T03:13:33.124412+0000","last_became_peered":"2024-09-17T03:13:33.124412+0000","last_unstale":"2024-09-17T03:13:39.158741+0000","last_undegraded":"2024-09-17T03:13:39.158741+0000","last_fullsized":"2024-09-17T03:13:39.158741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196954+0000","last_change":"2024-09-17T03:13:34.126417+0000","last_active":"2024-09-17T03:13:39.196954+0000","last_peered":"2024-09-17T03:13:39.196954+0000","last_clean":"2024-09-17T03:13:39.196954+0000","last_became_active":"2024-09-17T03:13:34.126094+0000","last_became_peered":"2024-09-17T03:13:34.126094+0000","last_unstale":"2024-09-17T03:13:39.196954+0000","last_undegraded":"2024-09-17T03:13:39.196954+0000","last_fullsized":"2024-09-17T03:13:39.196954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195295+0000","last_change":"2024-09-17T03:13:38.181805+0000","last_active":"2024-09-17T03:13:39.195295+0000","last_peered":"2024-09-17T03:13:39.195295+0000","last_clean":"2024-09-17T03:13:39.195295+0000","last_became_active":"2024-09-17T03:13:38.181287+0000","last_became_peered":"2024-09-17T03:13:38.181287+0000","last_unstale":"2024-09-17T03:13:39.195295+0000","last_undegraded":"2024-09-17T03:13:39.195295+0000","last_fullsized":"2024-09-17T03:13:39.195295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:17.193253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194766+0000","last_change":"2024-09-17T03:13:34.125233+0000","last_active":"2024-09-17T03:13:39.194766+0000","last_peered":"2024-09-17T03:13:39.194766+0000","last_clean":"2024-09-17T03:13:39.194766+0000","last_became_active":"2024-09-17T03:13:34.115962+0000","last_became_peered":"2024-09-17T03:13:34.115962+0000","last_unstale":"2024-09-17T03:13:39.194766+0000","last_undegraded":"2024-09-17T03:13:39.194766+0000","last_fullsized":"2024-09-17T03:13:39.194766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194622+0000","last_change":"2024-09-17T03:13:34.142202+0000","last_active":"2024-09-17T03:13:39.194622+0000","last_peered":"2024-09-17T03:13:39.194622+0000","last_clean":"2024-09-17T03:13:39.194622+0000","last_became_active":"2024-09-17T03:13:34.141894+0000","last_became_peered":"2024-09-17T03:13:34.141894+0000","last_unstale":"2024-09-17T03:13:39.194622+0000","last_undegraded":"2024-09-17T03:13:39.194622+0000","last_fullsized":"2024-09-17T03:13:39.194622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198442+0000","last_change":"2024-09-17T03:13:34.128354+0000","last_active":"2024-09-17T03:13:39.198442+0000","last_peered":"2024-09-17T03:13:39.198442+0000","last_clean":"2024-09-17T03:13:39.198442+0000","last_became_active":"2024-09-17T03:13:34.128064+0000","last_became_peered":"2024-09-17T03:13:34.128064+0000","last_unstale":"2024-09-17T03:13:39.198442+0000","last_undegraded":"2024-09-17T03:13:39.198442+0000","last_fullsized":"2024-09-17T03:13:39.198442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158623+0000","last_change":"2024-09-17T03:13:34.140919+0000","last_active":"2024-09-17T03:13:39.158623+0000","last_peered":"2024-09-17T03:13:39.158623+0000","last_clean":"2024-09-17T03:13:39.158623+0000","last_became_active":"2024-09-17T03:13:34.140561+0000","last_became_peered":"2024-09-17T03:13:34.140561+0000","last_unstale":"2024-09-17T03:13:39.158623+0000","last_undegraded":"2024-09-17T03:13:39.158623+0000","last_fullsized":"2024-09-17T03:13:39.158623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.397850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159371+0000","last_change":"2024-09-17T03:13:34.137429+0000","last_active":"2024-09-17T03:13:39.159371+0000","last_peered":"2024-09-17T03:13:39.159371+0000","last_clean":"2024-09-17T03:13:39.159371+0000","last_became_active":"2024-09-17T03:13:34.135149+0000","last_became_peered":"2024-09-17T03:13:34.135149+0000","last_unstale":"2024-09-17T03:13:39.159371+0000","last_undegraded":"2024-09-17T03:13:39.159371+0000","last_fullsized":"2024-09-17T03:13:39.159371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158439+0000","last_change":"2024-09-17T03:13:34.144580+0000","last_active":"2024-09-17T03:13:39.158439+0000","last_peered":"2024-09-17T03:13:39.158439+0000","last_clean":"2024-09-17T03:13:39.158439+0000","last_became_active":"2024-09-17T03:13:34.144100+0000","last_became_peered":"2024-09-17T03:13:34.144100+0000","last_unstale":"2024-09-17T03:13:39.158439+0000","last_undegraded":"2024-09-17T03:13:39.158439+0000","last_fullsized":"2024-09-17T03:13:39.158439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.561070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197089+0000","last_change":"2024-09-17T03:13:34.132354+0000","last_active":"2024-09-17T03:13:39.197089+0000","last_peered":"2024-09-17T03:13:39.197089+0000","last_clean":"2024-09-17T03:13:39.197089+0000","last_became_active":"2024-09-17T03:13:34.131250+0000","last_became_peered":"2024-09-17T03:13:34.131250+0000","last_unstale":"2024-09-17T03:13:39.197089+0000","last_undegraded":"2024-09-17T03:13:39.197089+0000","last_fullsized":"2024-09-17T03:13:39.197089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:41.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159577+0000","last_change":"2024-09-17T03:13:34.134701+0000","last_active":"2024-09-17T03:13:39.159577+0000","last_peered":"2024-09-17T03:13:39.159577+0000","last_clean":"2024-09-17T03:13:39.159577+0000","last_became_active":"2024-09-17T03:13:34.134341+0000","last_became_peered":"2024-09-17T03:13:34.134341+0000","last_unstale":"2024-09-17T03:13:39.159577+0000","last_undegraded":"2024-09-17T03:13:39.159577+0000","last_fullsized":"2024-09-17T03:13:39.159577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:36.866564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196579+0000","last_change":"2024-09-17T03:13:34.128615+0000","last_active":"2024-09-17T03:13:39.196579+0000","last_peered":"2024-09-17T03:13:39.196579+0000","last_clean":"2024-09-17T03:13:39.196579+0000","last_became_active":"2024-09-17T03:13:34.128116+0000","last_became_peered":"2024-09-17T03:13:34.128116+0000","last_unstale":"2024-09-17T03:13:39.196579+0000","last_undegraded":"2024-09-17T03:13:39.196579+0000","last_fullsized":"2024-09-17T03:13:39.196579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157351+0000","last_change":"2024-09-17T03:13:34.134305+0000","last_active":"2024-09-17T03:13:39.157351+0000","last_peered":"2024-09-17T03:13:39.157351+0000","last_clean":"2024-09-17T03:13:39.157351+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.157351+0000","last_undegraded":"2024-09-17T03:13:39.157351+0000","last_fullsized":"2024-09-17T03:13:39.157351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196833+0000","last_change":"2024-09-17T03:13:34.138279+0000","last_active":"2024-09-17T03:13:39.196833+0000","last_peered":"2024-09-17T03:13:39.196833+0000","last_clean":"2024-09-17T03:13:39.196833+0000","last_became_active":"2024-09-17T03:13:34.137706+0000","last_became_peered":"2024-09-17T03:13:34.137706+0000","last_unstale":"2024-09-17T03:13:39.196833+0000","last_undegraded":"2024-09-17T03:13:39.196833+0000","last_fullsized":"2024-09-17T03:13:39.196833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:02.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160062+0000","last_change":"2024-09-17T03:13:34.125660+0000","last_active":"2024-09-17T03:13:39.160062+0000","last_peered":"2024-09-17T03:13:39.160062+0000","last_clean":"2024-09-17T03:13:39.160062+0000","last_became_active":"2024-09-17T03:13:34.121581+0000","last_became_peered":"2024-09-17T03:13:34.121581+0000","last_unstale":"2024-09-17T03:13:39.160062+0000","last_undegraded":"2024-09-17T03:13:39.160062+0000","last_fullsized":"2024-09-17T03:13:39.160062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:13.154642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197789+0000","last_change":"2024-09-17T03:13:34.151296+0000","last_active":"2024-09-17T03:13:39.197789+0000","last_peered":"2024-09-17T03:13:39.197789+0000","last_clean":"2024-09-17T03:13:39.197789+0000","last_became_active":"2024-09-17T03:13:34.150833+0000","last_became_peered":"2024-09-17T03:13:34.150833+0000","last_unstale":"2024-09-17T03:13:39.197789+0000","last_undegraded":"2024-09-17T03:13:39.197789+0000","last_fullsized":"2024-09-17T03:13:39.197789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199481+0000","last_change":"2024-09-17T03:13:34.135844+0000","last_active":"2024-09-17T03:13:39.199481+0000","last_peered":"2024-09-17T03:13:39.199481+0000","last_clean":"2024-09-17T03:13:39.199481+0000","last_became_active":"2024-09-17T03:13:34.135484+0000","last_became_peered":"2024-09-17T03:13:34.135484+0000","last_unstale":"2024-09-17T03:13:39.199481+0000","last_undegraded":"2024-09-17T03:13:39.199481+0000","last_fullsized":"2024-09-17T03:13:39.199481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:39.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195346+0000","last_change":"2024-09-17T03:13:34.147615+0000","last_active":"2024-09-17T03:13:39.195346+0000","last_peered":"2024-09-17T03:13:39.195346+0000","last_clean":"2024-09-17T03:13:39.195346+0000","last_became_active":"2024-09-17T03:13:34.147373+0000","last_became_peered":"2024-09-17T03:13:34.147373+0000","last_unstale":"2024-09-17T03:13:39.195346+0000","last_undegraded":"2024-09-17T03:13:39.195346+0000","last_fullsized":"2024-09-17T03:13:39.195346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:00.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199570+0000","last_change":"2024-09-17T03:13:34.145347+0000","last_active":"2024-09-17T03:13:39.199570+0000","last_peered":"2024-09-17T03:13:39.199570+0000","last_clean":"2024-09-17T03:13:39.199570+0000","last_became_active":"2024-09-17T03:13:34.145057+0000","last_became_peered":"2024-09-17T03:13:34.145057+0000","last_unstale":"2024-09-17T03:13:39.199570+0000","last_undegraded":"2024-09-17T03:13:39.199570+0000","last_fullsized":"2024-09-17T03:13:39.199570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:29.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196508+0000","last_change":"2024-09-17T03:13:34.127450+0000","last_active":"2024-09-17T03:13:39.196508+0000","last_peered":"2024-09-17T03:13:39.196508+0000","last_clean":"2024-09-17T03:13:39.196508+0000","last_became_active":"2024-09-17T03:13:34.127169+0000","last_became_peered":"2024-09-17T03:13:34.127169+0000","last_unstale":"2024-09-17T03:13:39.196508+0000","last_undegraded":"2024-09-17T03:13:39.196508+0000","last_fullsized":"2024-09-17T03:13:39.196508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157187+0000","last_change":"2024-09-17T03:13:34.148947+0000","last_active":"2024-09-17T03:13:39.157187+0000","last_peered":"2024-09-17T03:13:39.157187+0000","last_clean":"2024-09-17T03:13:39.157187+0000","last_became_active":"2024-09-17T03:13:34.148584+0000","last_became_peered":"2024-09-17T03:13:34.148584+0000","last_unstale":"2024-09-17T03:13:39.157187+0000","last_undegraded":"2024-09-17T03:13:39.157187+0000","last_fullsized":"2024-09-17T03:13:39.157187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157720+0000","last_change":"2024-09-17T03:13:34.138509+0000","last_active":"2024-09-17T03:13:39.157720+0000","last_peered":"2024-09-17T03:13:39.157720+0000","last_clean":"2024-09-17T03:13:39.157720+0000","last_became_active":"2024-09-17T03:13:34.137862+0000","last_became_peered":"2024-09-17T03:13:34.137862+0000","last_unstale":"2024-09-17T03:13:39.157720+0000","last_undegraded":"2024-09-17T03:13:39.157720+0000","last_fullsized":"2024-09-17T03:13:39.157720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.125892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158457+0000","last_change":"2024-09-17T03:13:34.148276+0000","last_active":"2024-09-17T03:13:39.158457+0000","last_peered":"2024-09-17T03:13:39.158457+0000","last_clean":"2024-09-17T03:13:39.158457+0000","last_became_active":"2024-09-17T03:13:34.148053+0000","last_became_peered":"2024-09-17T03:13:34.148053+0000","last_unstale":"2024-09-17T03:13:39.158457+0000","last_undegraded":"2024-09-17T03:13:39.158457+0000","last_fullsized":"2024-09-17T03:13:39.158457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:23.791285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197786+0000","last_change":"2024-09-17T03:13:34.151106+0000","last_active":"2024-09-17T03:13:39.197786+0000","last_peered":"2024-09-17T03:13:39.197786+0000","last_clean":"2024-09-17T03:13:39.197786+0000","last_became_active":"2024-09-17T03:13:34.150584+0000","last_became_peered":"2024-09-17T03:13:34.150584+0000","last_unstale":"2024-09-17T03:13:39.197786+0000","last_undegraded":"2024-09-17T03:13:39.197786+0000","last_fullsized":"2024-09-17T03:13:39.197786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:11.890092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197394+0000","last_change":"2024-09-17T03:13:34.141641+0000","last_active":"2024-09-17T03:13:39.197394+0000","last_peered":"2024-09-17T03:13:39.197394+0000","last_clean":"2024-09-17T03:13:39.197394+0000","last_became_active":"2024-09-17T03:13:34.141338+0000","last_became_peered":"2024-09-17T03:13:34.141338+0000","last_unstale":"2024-09-17T03:13:39.197394+0000","last_undegraded":"2024-09-17T03:13:39.197394+0000","last_fullsized":"2024-09-17T03:13:39.197394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:35.475292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197098+0000","last_change":"2024-09-17T03:13:34.150804+0000","last_active":"2024-09-17T03:13:39.197098+0000","last_peered":"2024-09-17T03:13:39.197098+0000","last_clean":"2024-09-17T03:13:39.197098+0000","last_became_active":"2024-09-17T03:13:34.150486+0000","last_became_peered":"2024-09-17T03:13:34.150486+0000","last_unstale":"2024-09-17T03:13:39.197098+0000","last_undegraded":"2024-09-17T03:13:39.197098+0000","last_fullsized":"2024-09-17T03:13:39.197098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:18.029333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197517+0000","last_change":"2024-09-17T03:13:34.131477+0000","last_active":"2024-09-17T03:13:39.197517+0000","last_peered":"2024-09-17T03:13:39.197517+0000","last_clean":"2024-09-17T03:13:39.197517+0000","last_became_active":"2024-09-17T03:13:34.130564+0000","last_became_peered":"2024-09-17T03:13:34.130564+0000","last_unstale":"2024-09-17T03:13:39.197517+0000","last_undegraded":"2024-09-17T03:13:39.197517+0000","last_fullsized":"2024-09-17T03:13:39.197517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:34.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157103+0000","last_change":"2024-09-17T03:13:34.142799+0000","last_active":"2024-09-17T03:13:39.157103+0000","last_peered":"2024-09-17T03:13:39.157103+0000","last_clean":"2024-09-17T03:13:39.157103+0000","last_became_active":"2024-09-17T03:13:34.142494+0000","last_became_peered":"2024-09-17T03:13:34.142494+0000","last_unstale":"2024-09-17T03:13:39.157103+0000","last_undegraded":"2024-09-17T03:13:39.157103+0000","last_fullsized":"2024-09-17T03:13:39.157103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.778912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194970+0000","last_change":"2024-09-17T03:13:34.141400+0000","last_active":"2024-09-17T03:13:39.194970+0000","last_peered":"2024-09-17T03:13:39.194970+0000","last_clean":"2024-09-17T03:13:39.194970+0000","last_became_active":"2024-09-17T03:13:34.141088+0000","last_became_peered":"2024-09-17T03:13:34.141088+0000","last_unstale":"2024-09-17T03:13:39.194970+0000","last_undegraded":"2024-09-17T03:13:39.194970+0000","last_fullsized":"2024-09-17T03:13:39.194970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:34.516649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196351+0000","last_change":"2024-09-17T03:13:34.118085+0000","last_active":"2024-09-17T03:13:39.196351+0000","last_peered":"2024-09-17T03:13:39.196351+0000","last_clean":"2024-09-17T03:13:39.196351+0000","last_became_active":"2024-09-17T03:13:34.117665+0000","last_became_peered":"2024-09-17T03:13:34.117665+0000","last_unstale":"2024-09-17T03:13:39.196351+0000","last_undegraded":"2024-09-17T03:13:39.196351+0000","last_fullsized":"2024-09-17T03:13:39.196351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:31.700785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196520+0000","last_change":"2024-09-17T03:13:34.134663+0000","last_active":"2024-09-17T03:13:39.196520+0000","last_peered":"2024-09-17T03:13:39.196520+0000","last_clean":"2024-09-17T03:13:39.196520+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.196520+0000","last_undegraded":"2024-09-17T03:13:39.196520+0000","last_fullsized":"2024-09-17T03:13:39.196520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:54.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195773+0000","last_change":"2024-09-17T03:13:34.116909+0000","last_active":"2024-09-17T03:13:39.195773+0000","last_peered":"2024-09-17T03:13:39.195773+0000","last_clean":"2024-09-17T03:13:39.195773+0000","last_became_active":"2024-09-17T03:13:34.115590+0000","last_became_peered":"2024-09-17T03:13:34.115590+0000","last_unstale":"2024-09-17T03:13:39.195773+0000","last_undegraded":"2024-09-17T03:13:39.195773+0000","last_fullsized":"2024-09-17T03:13:39.195773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.277899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159836+0000","last_change":"2024-09-17T03:13:34.135845+0000","last_active":"2024-09-17T03:13:39.159836+0000","last_peered":"2024-09-17T03:13:39.159836+0000","last_clean":"2024-09-17T03:13:39.159836+0000","last_became_active":"2024-09-17T03:13:34.135526+0000","last_became_peered":"2024-09-17T03:13:34.135526+0000","last_unstale":"2024-09-17T03:13:39.159836+0000","last_undegraded":"2024-09-17T03:13:39.159836+0000","last_fullsized":"2024-09-17T03:13:39.159836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159196+0000","last_change":"2024-09-17T03:13:34.136523+0000","last_active":"2024-09-17T03:13:39.159196+0000","last_peered":"2024-09-17T03:13:39.159196+0000","last_clean":"2024-09-17T03:13:39.159196+0000","last_became_active":"2024-09-17T03:13:34.136202+0000","last_became_peered":"2024-09-17T03:13:34.136202+0000","last_unstale":"2024-09-17T03:13:39.159196+0000","last_undegraded":"2024-09-17T03:13:39.159196+0000","last_fullsized":"2024-09-17T03:13:39.159196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198096+0000","last_change":"2024-09-17T03:13:34.145425+0000","last_active":"2024-09-17T03:13:39.198096+0000","last_peered":"2024-09-17T03:13:39.198096+0000","last_clean":"2024-09-17T03:13:39.198096+0000","last_became_active":"2024-09-17T03:13:34.144888+0000","last_became_peered":"2024-09-17T03:13:34.144888+0000","last_unstale":"2024-09-17T03:13:39.198096+0000","last_undegraded":"2024-09-17T03:13:39.198096+0000","last_fullsized":"2024-09-17T03:13:39.198096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":112019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:58.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:59.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 -- 172.21.15.153:0/1003237543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0073dd0 msgr2=0x7f4ca006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 --2- 172.21.15.153:0/1003237543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0073dd0 0x7f4ca006ddf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ca015d980 tx=0x7f4c9002a530 comp rx=0 tx=0).stop 2024-09-17T03:13:59.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 -- 172.21.15.153:0/1003237543 shutdown_connections 2024-09-17T03:13:59.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 --2- 172.21.15.153:0/1003237543 >> v2:172.21.15.164:3300/0 conn(0x7f4ca006e330 0x7f4ca006ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 --2- 172.21.15.153:0/1003237543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0073dd0 0x7f4ca006ddf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 -- 172.21.15.153:0/1003237543 >> 172.21.15.153:0/1003237543 conn(0x7f4ca00cca40 msgr2=0x7f4ca00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:59.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 -- 172.21.15.153:0/1003237543 shutdown_connections 2024-09-17T03:13:59.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.151+0000 7f4ca8800640 1 -- 172.21.15.153:0/1003237543 wait complete. 2024-09-17T03:13:59.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.153+0000 7f4ca8800640 1 Processor -- start 2024-09-17T03:13:59.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.153+0000 7f4ca8800640 1 -- start start 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca006e330 0x7f4ca01f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ca0073dd0 0x7f4ca00cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f4a0 con 0x7f4ca0074cb0 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f320 con 0x7f4ca006e330 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca8800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca006f620 con 0x7f4ca0073dd0 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56500/0 (socket says 172.21.15.153:56500) 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca6800640 1 -- 172.21.15.153:0/3018197780 learned_addr learned my addr 172.21.15.153:0/3018197780 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca5e00640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca006e330 0x7f4ca01f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.155+0000 7f4ca5400640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ca0073dd0 0x7f4ca00cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 -- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ca0073dd0 msgr2=0x7f4ca00cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ca0073dd0 0x7f4ca00cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 -- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca006e330 msgr2=0x7f4ca01f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca006e330 0x7f4ca01f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 -- 172.21.15.153:0/3018197780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca01f5520 con 0x7f4ca0074cb0 2024-09-17T03:13:59.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca6800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00e9c0 tx=0x7f4c9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c004d20 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c9c00cb20 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005020 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca01f5790 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.156+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca01f5d50 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.158+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca006fb80 con 0x7f4ca0074cb0 2024-09-17T03:13:59.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.159+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c9c0051c0 con 0x7f4ca0074cb0 2024-09-17T03:13:59.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.159+0000 7f4c9a000640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.160+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4c9c09b910 con 0x7f4ca0074cb0 2024-09-17T03:13:59.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.160+0000 7f4ca5e00640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.161+0000 7f4ca5e00640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 0x7f4c8407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007fd0 tx=0x7f4c94009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:59.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.164+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c9c016030 con 0x7f4ca0074cb0 2024-09-17T03:13:59.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.344+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ca01f2df0 con 0x7f4c84078b90 2024-09-17T03:13:59.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.350+0000 7f4c9a000640 1 -- 172.21.15.153:0/3018197780 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f4ca01f2df0 con 0x7f4c84078b90 2024-09-17T03:13:59.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:13:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 msgr2=0x7f4c8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 0x7f4c8407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007fd0 tx=0x7f4c94009040 comp rx=0 tx=0).stop 2024-09-17T03:13:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 msgr2=0x7f4ca00cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00e9c0 tx=0x7f4c9c00ee80 comp rx=0 tx=0).stop 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 shutdown_connections 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ca0074cb0 0x7f4ca00cf350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4ca0073dd0 0x7f4ca00cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 --2- 172.21.15.153:0/3018197780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca006e330 0x7f4ca01f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 >> 172.21.15.153:0/3018197780 conn(0x7f4ca00cca40 msgr2=0x7f4ca0159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 shutdown_connections 2024-09-17T03:13:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.355+0000 7f4ca8800640 1 -- 172.21.15.153:0/3018197780 wait complete. 2024-09-17T03:13:59.376 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-17T03:13:58.823469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3514368,"data_stored":2081512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003781"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160943+0000","last_change":"2024-09-17T03:13:33.123350+0000","last_active":"2024-09-17T03:13:39.160943+0000","last_peered":"2024-09-17T03:13:39.160943+0000","last_clean":"2024-09-17T03:13:39.160943+0000","last_became_active":"2024-09-17T03:13:33.122982+0000","last_became_peered":"2024-09-17T03:13:33.122982+0000","last_unstale":"2024-09-17T03:13:39.160943+0000","last_undegraded":"2024-09-17T03:13:39.160943+0000","last_fullsized":"2024-09-17T03:13:39.160943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.030877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159339+0000","last_change":"2024-09-17T03:13:34.133910+0000","last_active":"2024-09-17T03:13:39.159339+0000","last_peered":"2024-09-17T03:13:39.159339+0000","last_clean":"2024-09-17T03:13:39.159339+0000","last_became_active":"2024-09-17T03:13:34.133495+0000","last_became_peered":"2024-09-17T03:13:34.133495+0000","last_unstale":"2024-09-17T03:13:39.159339+0000","last_undegraded":"2024-09-17T03:13:39.159339+0000","last_fullsized":"2024-09-17T03:13:39.159339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:06.942420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194823+0000","last_change":"2024-09-17T03:13:38.178584+0000","last_active":"2024-09-17T03:13:39.194823+0000","last_peered":"2024-09-17T03:13:39.194823+0000","last_clean":"2024-09-17T03:13:39.194823+0000","last_became_active":"2024-09-17T03:13:38.176304+0000","last_became_peered":"2024-09-17T03:13:38.176304+0000","last_unstale":"2024-09-17T03:13:39.194823+0000","last_undegraded":"2024-09-17T03:13:39.194823+0000","last_fullsized":"2024-09-17T03:13:39.194823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:12.541698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159446+0000","last_change":"2024-09-17T03:13:33.127434+0000","last_active":"2024-09-17T03:13:39.159446+0000","last_peered":"2024-09-17T03:13:39.159446+0000","last_clean":"2024-09-17T03:13:39.159446+0000","last_became_active":"2024-09-17T03:13:33.127048+0000","last_became_peered":"2024-09-17T03:13:33.127048+0000","last_unstale":"2024-09-17T03:13:39.159446+0000","last_undegraded":"2024-09-17T03:13:39.159446+0000","last_fullsized":"2024-09-17T03:13:39.159446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159903+0000","last_change":"2024-09-17T03:13:34.133739+0000","last_active":"2024-09-17T03:13:39.159903+0000","last_peered":"2024-09-17T03:13:39.159903+0000","last_clean":"2024-09-17T03:13:39.159903+0000","last_became_active":"2024-09-17T03:13:34.132902+0000","last_became_peered":"2024-09-17T03:13:34.132902+0000","last_unstale":"2024-09-17T03:13:39.159903+0000","last_undegraded":"2024-09-17T03:13:39.159903+0000","last_fullsized":"2024-09-17T03:13:39.159903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194767+0000","last_change":"2024-09-17T03:13:38.169585+0000","last_active":"2024-09-17T03:13:39.194767+0000","last_peered":"2024-09-17T03:13:39.194767+0000","last_clean":"2024-09-17T03:13:39.194767+0000","last_became_active":"2024-09-17T03:13:38.169149+0000","last_became_peered":"2024-09-17T03:13:38.169149+0000","last_unstale":"2024-09-17T03:13:39.194767+0000","last_undegraded":"2024-09-17T03:13:39.194767+0000","last_fullsized":"2024-09-17T03:13:39.194767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.817523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197699+0000","last_change":"2024-09-17T03:13:33.136982+0000","last_active":"2024-09-17T03:13:39.197699+0000","last_peered":"2024-09-17T03:13:39.197699+0000","last_clean":"2024-09-17T03:13:39.197699+0000","last_became_active":"2024-09-17T03:13:33.136263+0000","last_became_peered":"2024-09-17T03:13:33.136263+0000","last_unstale":"2024-09-17T03:13:39.197699+0000","last_undegraded":"2024-09-17T03:13:39.197699+0000","last_fullsized":"2024-09-17T03:13:39.197699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:15.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195911+0000","last_change":"2024-09-17T03:13:34.131912+0000","last_active":"2024-09-17T03:13:39.195911+0000","last_peered":"2024-09-17T03:13:39.195911+0000","last_clean":"2024-09-17T03:13:39.195911+0000","last_became_active":"2024-09-17T03:13:34.130908+0000","last_became_peered":"2024-09-17T03:13:34.130908+0000","last_unstale":"2024-09-17T03:13:39.195911+0000","last_undegraded":"2024-09-17T03:13:39.195911+0000","last_fullsized":"2024-09-17T03:13:39.195911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:09.565865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196018+0000","last_change":"2024-09-17T03:13:38.170051+0000","last_active":"2024-09-17T03:13:39.196018+0000","last_peered":"2024-09-17T03:13:39.196018+0000","last_clean":"2024-09-17T03:13:39.196018+0000","last_became_active":"2024-09-17T03:13:38.169083+0000","last_became_peered":"2024-09-17T03:13:38.169083+0000","last_unstale":"2024-09-17T03:13:39.196018+0000","last_undegraded":"2024-09-17T03:13:39.196018+0000","last_fullsized":"2024-09-17T03:13:39.196018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:53.571359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197904+0000","last_change":"2024-09-17T03:13:33.132790+0000","last_active":"2024-09-17T03:13:39.197904+0000","last_peered":"2024-09-17T03:13:39.197904+0000","last_clean":"2024-09-17T03:13:39.197904+0000","last_became_active":"2024-09-17T03:13:33.132482+0000","last_became_peered":"2024-09-17T03:13:33.132482+0000","last_unstale":"2024-09-17T03:13:39.197904+0000","last_undegraded":"2024-09-17T03:13:39.197904+0000","last_fullsized":"2024-09-17T03:13:39.197904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:36.557061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199238+0000","last_change":"2024-09-17T03:13:34.152246+0000","last_active":"2024-09-17T03:13:39.199238+0000","last_peered":"2024-09-17T03:13:39.199238+0000","last_clean":"2024-09-17T03:13:39.199238+0000","last_became_active":"2024-09-17T03:13:34.151761+0000","last_became_peered":"2024-09-17T03:13:34.151761+0000","last_unstale":"2024-09-17T03:13:39.199238+0000","last_undegraded":"2024-09-17T03:13:39.199238+0000","last_fullsized":"2024-09-17T03:13:39.199238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:55.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195385+0000","last_change":"2024-09-17T03:13:38.182362+0000","last_active":"2024-09-17T03:13:39.195385+0000","last_peered":"2024-09-17T03:13:39.195385+0000","last_clean":"2024-09-17T03:13:39.195385+0000","last_became_active":"2024-09-17T03:13:38.181949+0000","last_became_peered":"2024-09-17T03:13:38.181949+0000","last_unstale":"2024-09-17T03:13:39.195385+0000","last_undegraded":"2024-09-17T03:13:39.195385+0000","last_fullsized":"2024-09-17T03:13:39.195385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:21.583400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198556+0000","last_change":"2024-09-17T03:13:34.130957+0000","last_active":"2024-09-17T03:13:39.198556+0000","last_peered":"2024-09-17T03:13:39.198556+0000","last_clean":"2024-09-17T03:13:39.198556+0000","last_became_active":"2024-09-17T03:13:34.130643+0000","last_became_peered":"2024-09-17T03:13:34.130643+0000","last_unstale":"2024-09-17T03:13:39.198556+0000","last_undegraded":"2024-09-17T03:13:39.198556+0000","last_fullsized":"2024-09-17T03:13:39.198556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:30.079731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198915+0000","last_change":"2024-09-17T03:13:33.121803+0000","last_active":"2024-09-17T03:13:39.198915+0000","last_peered":"2024-09-17T03:13:39.198915+0000","last_clean":"2024-09-17T03:13:39.198915+0000","last_became_active":"2024-09-17T03:13:33.121396+0000","last_became_peered":"2024-09-17T03:13:33.121396+0000","last_unstale":"2024-09-17T03:13:39.198915+0000","last_undegraded":"2024-09-17T03:13:39.198915+0000","last_fullsized":"2024-09-17T03:13:39.198915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.691866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199170+0000","last_change":"2024-09-17T03:13:38.182273+0000","last_active":"2024-09-17T03:13:39.199170+0000","last_peered":"2024-09-17T03:13:39.199170+0000","last_clean":"2024-09-17T03:13:39.199170+0000","last_became_active":"2024-09-17T03:13:38.177607+0000","last_became_peered":"2024-09-17T03:13:38.177607+0000","last_unstale":"2024-09-17T03:13:39.199170+0000","last_undegraded":"2024-09-17T03:13:39.199170+0000","last_fullsized":"2024-09-17T03:13:39.199170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:00.908914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194949+0000","last_change":"2024-09-17T03:13:34.143115+0000","last_active":"2024-09-17T03:13:39.194949+0000","last_peered":"2024-09-17T03:13:39.194949+0000","last_clean":"2024-09-17T03:13:39.194949+0000","last_became_active":"2024-09-17T03:13:34.142792+0000","last_became_peered":"2024-09-17T03:13:34.142792+0000","last_unstale":"2024-09-17T03:13:39.194949+0000","last_undegraded":"2024-09-17T03:13:39.194949+0000","last_fullsized":"2024-09-17T03:13:39.194949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:16.120196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158223+0000","last_change":"2024-09-17T03:13:33.119000+0000","last_active":"2024-09-17T03:13:39.158223+0000","last_peered":"2024-09-17T03:13:39.158223+0000","last_clean":"2024-09-17T03:13:39.158223+0000","last_became_active":"2024-09-17T03:13:33.118137+0000","last_became_peered":"2024-09-17T03:13:33.118137+0000","last_unstale":"2024-09-17T03:13:39.158223+0000","last_undegraded":"2024-09-17T03:13:39.158223+0000","last_fullsized":"2024-09-17T03:13:39.158223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:48.663689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197652+0000","last_change":"2024-09-17T03:13:38.169936+0000","last_active":"2024-09-17T03:13:39.197652+0000","last_peered":"2024-09-17T03:13:39.197652+0000","last_clean":"2024-09-17T03:13:39.197652+0000","last_became_active":"2024-09-17T03:13:38.169497+0000","last_became_peered":"2024-09-17T03:13:38.169497+0000","last_unstale":"2024-09-17T03:13:39.197652+0000","last_undegraded":"2024-09-17T03:13:39.197652+0000","last_fullsized":"2024-09-17T03:13:39.197652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:41.815068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160080+0000","last_change":"2024-09-17T03:13:34.140522+0000","last_active":"2024-09-17T03:13:39.160080+0000","last_peered":"2024-09-17T03:13:39.160080+0000","last_clean":"2024-09-17T03:13:39.160080+0000","last_became_active":"2024-09-17T03:13:34.140149+0000","last_became_peered":"2024-09-17T03:13:34.140149+0000","last_unstale":"2024-09-17T03:13:39.160080+0000","last_undegraded":"2024-09-17T03:13:39.160080+0000","last_fullsized":"2024-09-17T03:13:39.160080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:16.959470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161158+0000","last_change":"2024-09-17T03:13:33.137244+0000","last_active":"2024-09-17T03:13:39.161158+0000","last_peered":"2024-09-17T03:13:39.161158+0000","last_clean":"2024-09-17T03:13:39.161158+0000","last_became_active":"2024-09-17T03:13:33.136903+0000","last_became_peered":"2024-09-17T03:13:33.136903+0000","last_unstale":"2024-09-17T03:13:39.161158+0000","last_undegraded":"2024-09-17T03:13:39.161158+0000","last_fullsized":"2024-09-17T03:13:39.161158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195505+0000","last_change":"2024-09-17T03:13:38.177994+0000","last_active":"2024-09-17T03:13:39.195505+0000","last_peered":"2024-09-17T03:13:39.195505+0000","last_clean":"2024-09-17T03:13:39.195505+0000","last_became_active":"2024-09-17T03:13:38.177478+0000","last_became_peered":"2024-09-17T03:13:38.177478+0000","last_unstale":"2024-09-17T03:13:39.195505+0000","last_undegraded":"2024-09-17T03:13:39.195505+0000","last_fullsized":"2024-09-17T03:13:39.195505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:12.414341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198055+0000","last_change":"2024-09-17T03:13:34.130179+0000","last_active":"2024-09-17T03:13:39.198055+0000","last_peered":"2024-09-17T03:13:39.198055+0000","last_clean":"2024-09-17T03:13:39.198055+0000","last_became_active":"2024-09-17T03:13:34.129884+0000","last_became_peered":"2024-09-17T03:13:34.129884+0000","last_unstale":"2024-09-17T03:13:39.198055+0000","last_undegraded":"2024-09-17T03:13:39.198055+0000","last_fullsized":"2024-09-17T03:13:39.198055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:50.196855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194458+0000","last_change":"2024-09-17T03:13:33.122054+0000","last_active":"2024-09-17T03:13:39.194458+0000","last_peered":"2024-09-17T03:13:39.194458+0000","last_clean":"2024-09-17T03:13:39.194458+0000","last_became_active":"2024-09-17T03:13:33.121698+0000","last_became_peered":"2024-09-17T03:13:33.121698+0000","last_unstale":"2024-09-17T03:13:39.194458+0000","last_undegraded":"2024-09-17T03:13:39.194458+0000","last_fullsized":"2024-09-17T03:13:39.194458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:57.578178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198044+0000","last_change":"2024-09-17T03:13:38.171631+0000","last_active":"2024-09-17T03:13:39.198044+0000","last_peered":"2024-09-17T03:13:39.198044+0000","last_clean":"2024-09-17T03:13:39.198044+0000","last_became_active":"2024-09-17T03:13:38.171240+0000","last_became_peered":"2024-09-17T03:13:38.171240+0000","last_unstale":"2024-09-17T03:13:39.198044+0000","last_undegraded":"2024-09-17T03:13:39.198044+0000","last_fullsized":"2024-09-17T03:13:39.198044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:01.719989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161020+0000","last_change":"2024-09-17T03:13:34.140177+0000","last_active":"2024-09-17T03:13:39.161020+0000","last_peered":"2024-09-17T03:13:39.161020+0000","last_clean":"2024-09-17T03:13:39.161020+0000","last_became_active":"2024-09-17T03:13:34.139841+0000","last_became_peered":"2024-09-17T03:13:34.139841+0000","last_unstale":"2024-09-17T03:13:39.161020+0000","last_undegraded":"2024-09-17T03:13:39.161020+0000","last_fullsized":"2024-09-17T03:13:39.161020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199584+0000","last_change":"2024-09-17T03:13:33.130507+0000","last_active":"2024-09-17T03:13:39.199584+0000","last_peered":"2024-09-17T03:13:39.199584+0000","last_clean":"2024-09-17T03:13:39.199584+0000","last_became_active":"2024-09-17T03:13:33.130209+0000","last_became_peered":"2024-09-17T03:13:33.130209+0000","last_unstale":"2024-09-17T03:13:39.199584+0000","last_undegraded":"2024-09-17T03:13:39.199584+0000","last_fullsized":"2024-09-17T03:13:39.199584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:15.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195482+0000","last_change":"2024-09-17T03:13:38.168304+0000","last_active":"2024-09-17T03:13:39.195482+0000","last_peered":"2024-09-17T03:13:39.195482+0000","last_clean":"2024-09-17T03:13:39.195482+0000","last_became_active":"2024-09-17T03:13:38.168009+0000","last_became_peered":"2024-09-17T03:13:38.168009+0000","last_unstale":"2024-09-17T03:13:39.195482+0000","last_undegraded":"2024-09-17T03:13:39.195482+0000","last_fullsized":"2024-09-17T03:13:39.195482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:37.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160808+0000","last_change":"2024-09-17T03:13:34.126671+0000","last_active":"2024-09-17T03:13:39.160808+0000","last_peered":"2024-09-17T03:13:39.160808+0000","last_clean":"2024-09-17T03:13:39.160808+0000","last_became_active":"2024-09-17T03:13:34.126376+0000","last_became_peered":"2024-09-17T03:13:34.126376+0000","last_unstale":"2024-09-17T03:13:39.160808+0000","last_undegraded":"2024-09-17T03:13:39.160808+0000","last_fullsized":"2024-09-17T03:13:39.160808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161109+0000","last_change":"2024-09-17T03:13:33.137148+0000","last_active":"2024-09-17T03:13:39.161109+0000","last_peered":"2024-09-17T03:13:39.161109+0000","last_clean":"2024-09-17T03:13:39.161109+0000","last_became_active":"2024-09-17T03:13:33.136897+0000","last_became_peered":"2024-09-17T03:13:33.136897+0000","last_unstale":"2024-09-17T03:13:39.161109+0000","last_undegraded":"2024-09-17T03:13:39.161109+0000","last_fullsized":"2024-09-17T03:13:39.161109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160118+0000","last_change":"2024-09-17T03:13:38.176096+0000","last_active":"2024-09-17T03:13:39.160118+0000","last_peered":"2024-09-17T03:13:39.160118+0000","last_clean":"2024-09-17T03:13:39.160118+0000","last_became_active":"2024-09-17T03:13:38.170721+0000","last_became_peered":"2024-09-17T03:13:38.170721+0000","last_unstale":"2024-09-17T03:13:39.160118+0000","last_undegraded":"2024-09-17T03:13:39.160118+0000","last_fullsized":"2024-09-17T03:13:39.160118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.067944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159455+0000","last_change":"2024-09-17T03:13:34.128263+0000","last_active":"2024-09-17T03:13:39.159455+0000","last_peered":"2024-09-17T03:13:39.159455+0000","last_clean":"2024-09-17T03:13:39.159455+0000","last_became_active":"2024-09-17T03:13:34.127855+0000","last_became_peered":"2024-09-17T03:13:34.127855+0000","last_unstale":"2024-09-17T03:13:39.159455+0000","last_undegraded":"2024-09-17T03:13:39.159455+0000","last_fullsized":"2024-09-17T03:13:39.159455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:48.610659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199587+0000","last_change":"2024-09-17T03:13:33.119090+0000","last_active":"2024-09-17T03:13:39.199587+0000","last_peered":"2024-09-17T03:13:39.199587+0000","last_clean":"2024-09-17T03:13:39.199587+0000","last_became_active":"2024-09-17T03:13:33.118370+0000","last_became_peered":"2024-09-17T03:13:33.118370+0000","last_unstale":"2024-09-17T03:13:39.199587+0000","last_undegraded":"2024-09-17T03:13:39.199587+0000","last_fullsized":"2024-09-17T03:13:39.199587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:40.438813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158397+0000","last_change":"2024-09-17T03:13:38.170311+0000","last_active":"2024-09-17T03:13:39.158397+0000","last_peered":"2024-09-17T03:13:39.158397+0000","last_clean":"2024-09-17T03:13:39.158397+0000","last_became_active":"2024-09-17T03:13:38.169794+0000","last_became_peered":"2024-09-17T03:13:38.169794+0000","last_unstale":"2024-09-17T03:13:39.158397+0000","last_undegraded":"2024-09-17T03:13:39.158397+0000","last_fullsized":"2024-09-17T03:13:39.158397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:47.182972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196860+0000","last_change":"2024-09-17T03:13:34.123331+0000","last_active":"2024-09-17T03:13:39.196860+0000","last_peered":"2024-09-17T03:13:39.196860+0000","last_clean":"2024-09-17T03:13:39.196860+0000","last_became_active":"2024-09-17T03:13:34.120225+0000","last_became_peered":"2024-09-17T03:13:34.120225+0000","last_unstale":"2024-09-17T03:13:39.196860+0000","last_undegraded":"2024-09-17T03:13:39.196860+0000","last_fullsized":"2024-09-17T03:13:39.196860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:15.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158326+0000","last_change":"2024-09-17T03:13:33.128407+0000","last_active":"2024-09-17T03:13:39.158326+0000","last_peered":"2024-09-17T03:13:39.158326+0000","last_clean":"2024-09-17T03:13:39.158326+0000","last_became_active":"2024-09-17T03:13:33.128078+0000","last_became_peered":"2024-09-17T03:13:33.128078+0000","last_unstale":"2024-09-17T03:13:39.158326+0000","last_undegraded":"2024-09-17T03:13:39.158326+0000","last_fullsized":"2024-09-17T03:13:39.158326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157547+0000","last_change":"2024-09-17T03:13:38.170011+0000","last_active":"2024-09-17T03:13:39.157547+0000","last_peered":"2024-09-17T03:13:39.157547+0000","last_clean":"2024-09-17T03:13:39.157547+0000","last_became_active":"2024-09-17T03:13:38.169510+0000","last_became_peered":"2024-09-17T03:13:38.169510+0000","last_unstale":"2024-09-17T03:13:39.157547+0000","last_undegraded":"2024-09-17T03:13:39.157547+0000","last_fullsized":"2024-09-17T03:13:39.157547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:32.997939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196289+0000","last_change":"2024-09-17T03:13:34.150966+0000","last_active":"2024-09-17T03:13:39.196289+0000","last_peered":"2024-09-17T03:13:39.196289+0000","last_clean":"2024-09-17T03:13:39.196289+0000","last_became_active":"2024-09-17T03:13:34.150654+0000","last_became_peered":"2024-09-17T03:13:34.150654+0000","last_unstale":"2024-09-17T03:13:39.196289+0000","last_undegraded":"2024-09-17T03:13:39.196289+0000","last_fullsized":"2024-09-17T03:13:39.196289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:41.752422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198782+0000","last_change":"2024-09-17T03:13:33.125357+0000","last_active":"2024-09-17T03:13:39.198782+0000","last_peered":"2024-09-17T03:13:39.198782+0000","last_clean":"2024-09-17T03:13:39.198782+0000","last_became_active":"2024-09-17T03:13:33.124855+0000","last_became_peered":"2024-09-17T03:13:33.124855+0000","last_unstale":"2024-09-17T03:13:39.198782+0000","last_undegraded":"2024-09-17T03:13:39.198782+0000","last_fullsized":"2024-09-17T03:13:39.198782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.725350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159207+0000","last_change":"2024-09-17T03:13:38.174646+0000","last_active":"2024-09-17T03:13:39.159207+0000","last_peered":"2024-09-17T03:13:39.159207+0000","last_clean":"2024-09-17T03:13:39.159207+0000","last_became_active":"2024-09-17T03:13:38.172014+0000","last_became_peered":"2024-09-17T03:13:38.172014+0000","last_unstale":"2024-09-17T03:13:39.159207+0000","last_undegraded":"2024-09-17T03:13:39.159207+0000","last_fullsized":"2024-09-17T03:13:39.159207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:00.671761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157242+0000","last_change":"2024-09-17T03:13:34.139654+0000","last_active":"2024-09-17T03:13:39.157242+0000","last_peered":"2024-09-17T03:13:39.157242+0000","last_clean":"2024-09-17T03:13:39.157242+0000","last_became_active":"2024-09-17T03:13:34.139302+0000","last_became_peered":"2024-09-17T03:13:34.139302+0000","last_unstale":"2024-09-17T03:13:39.157242+0000","last_undegraded":"2024-09-17T03:13:39.157242+0000","last_fullsized":"2024-09-17T03:13:39.157242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:17.544789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194921+0000","last_change":"2024-09-17T03:13:33.125260+0000","last_active":"2024-09-17T03:13:39.194921+0000","last_peered":"2024-09-17T03:13:39.194921+0000","last_clean":"2024-09-17T03:13:39.194921+0000","last_became_active":"2024-09-17T03:13:33.124837+0000","last_became_peered":"2024-09-17T03:13:33.124837+0000","last_unstale":"2024-09-17T03:13:39.194921+0000","last_undegraded":"2024-09-17T03:13:39.194921+0000","last_fullsized":"2024-09-17T03:13:39.194921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:23.954202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159089+0000","last_change":"2024-09-17T03:13:38.182098+0000","last_active":"2024-09-17T03:13:39.159089+0000","last_peered":"2024-09-17T03:13:39.159089+0000","last_clean":"2024-09-17T03:13:39.159089+0000","last_became_active":"2024-09-17T03:13:38.181677+0000","last_became_peered":"2024-09-17T03:13:38.181677+0000","last_unstale":"2024-09-17T03:13:39.159089+0000","last_undegraded":"2024-09-17T03:13:39.159089+0000","last_fullsized":"2024-09-17T03:13:39.159089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.122052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157898+0000","last_change":"2024-09-17T03:13:34.137074+0000","last_active":"2024-09-17T03:13:39.157898+0000","last_peered":"2024-09-17T03:13:39.157898+0000","last_clean":"2024-09-17T03:13:39.157898+0000","last_became_active":"2024-09-17T03:13:34.133966+0000","last_became_peered":"2024-09-17T03:13:34.133966+0000","last_unstale":"2024-09-17T03:13:39.157898+0000","last_undegraded":"2024-09-17T03:13:39.157898+0000","last_fullsized":"2024-09-17T03:13:39.157898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.873331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196689+0000","last_change":"2024-09-17T03:13:33.126182+0000","last_active":"2024-09-17T03:13:39.196689+0000","last_peered":"2024-09-17T03:13:39.196689+0000","last_clean":"2024-09-17T03:13:39.196689+0000","last_became_active":"2024-09-17T03:13:33.121972+0000","last_became_peered":"2024-09-17T03:13:33.121972+0000","last_unstale":"2024-09-17T03:13:39.196689+0000","last_undegraded":"2024-09-17T03:13:39.196689+0000","last_fullsized":"2024-09-17T03:13:39.196689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:42.270063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159179+0000","last_change":"2024-09-17T03:13:38.168583+0000","last_active":"2024-09-17T03:13:39.159179+0000","last_peered":"2024-09-17T03:13:39.159179+0000","last_clean":"2024-09-17T03:13:39.159179+0000","last_became_active":"2024-09-17T03:13:38.168090+0000","last_became_peered":"2024-09-17T03:13:38.168090+0000","last_unstale":"2024-09-17T03:13:39.159179+0000","last_undegraded":"2024-09-17T03:13:39.159179+0000","last_fullsized":"2024-09-17T03:13:39.159179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:54.235466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160787+0000","last_change":"2024-09-17T03:13:34.112239+0000","last_active":"2024-09-17T03:13:39.160787+0000","last_peered":"2024-09-17T03:13:39.160787+0000","last_clean":"2024-09-17T03:13:39.160787+0000","last_became_active":"2024-09-17T03:13:34.111911+0000","last_became_peered":"2024-09-17T03:13:34.111911+0000","last_unstale":"2024-09-17T03:13:39.160787+0000","last_undegraded":"2024-09-17T03:13:39.160787+0000","last_fullsized":"2024-09-17T03:13:39.160787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:08.503088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198916+0000","last_change":"2024-09-17T03:13:33.125715+0000","last_active":"2024-09-17T03:13:39.198916+0000","last_peered":"2024-09-17T03:13:39.198916+0000","last_clean":"2024-09-17T03:13:39.198916+0000","last_became_active":"2024-09-17T03:13:33.125194+0000","last_became_peered":"2024-09-17T03:13:33.125194+0000","last_unstale":"2024-09-17T03:13:39.198916+0000","last_undegraded":"2024-09-17T03:13:39.198916+0000","last_fullsized":"2024-09-17T03:13:39.198916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:19.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":118,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196858+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:13:39.196858+0000","last_peered":"2024-09-17T03:13:39.196858+0000","last_clean":"2024-09-17T03:13:39.196858+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:13:39.196858+0000","last_undegraded":"2024-09-17T03:13:39.196858+0000","last_fullsized":"2024-09-17T03:13:39.196858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199547+0000","last_change":"2024-09-17T03:13:38.167682+0000","last_active":"2024-09-17T03:13:39.199547+0000","last_peered":"2024-09-17T03:13:39.199547+0000","last_clean":"2024-09-17T03:13:39.199547+0000","last_became_active":"2024-09-17T03:13:38.167110+0000","last_became_peered":"2024-09-17T03:13:38.167110+0000","last_unstale":"2024-09-17T03:13:39.199547+0000","last_undegraded":"2024-09-17T03:13:39.199547+0000","last_fullsized":"2024-09-17T03:13:39.199547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:12.466588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199361+0000","last_change":"2024-09-17T03:13:34.131142+0000","last_active":"2024-09-17T03:13:39.199361+0000","last_peered":"2024-09-17T03:13:39.199361+0000","last_clean":"2024-09-17T03:13:39.199361+0000","last_became_active":"2024-09-17T03:13:34.130839+0000","last_became_peered":"2024-09-17T03:13:34.130839+0000","last_unstale":"2024-09-17T03:13:39.199361+0000","last_undegraded":"2024-09-17T03:13:39.199361+0000","last_fullsized":"2024-09-17T03:13:39.199361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:37.776457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159474+0000","last_change":"2024-09-17T03:13:33.133189+0000","last_active":"2024-09-17T03:13:39.159474+0000","last_peered":"2024-09-17T03:13:39.159474+0000","last_clean":"2024-09-17T03:13:39.159474+0000","last_became_active":"2024-09-17T03:13:33.132836+0000","last_became_peered":"2024-09-17T03:13:33.132836+0000","last_unstale":"2024-09-17T03:13:39.159474+0000","last_undegraded":"2024-09-17T03:13:39.159474+0000","last_fullsized":"2024-09-17T03:13:39.159474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:51.274515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196215+0000","last_change":"2024-09-17T03:13:38.183375+0000","last_active":"2024-09-17T03:13:39.196215+0000","last_peered":"2024-09-17T03:13:39.196215+0000","last_clean":"2024-09-17T03:13:39.196215+0000","last_became_active":"2024-09-17T03:13:38.182947+0000","last_became_peered":"2024-09-17T03:13:38.182947+0000","last_unstale":"2024-09-17T03:13:39.196215+0000","last_undegraded":"2024-09-17T03:13:39.196215+0000","last_fullsized":"2024-09-17T03:13:39.196215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.792778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197849+0000","last_change":"2024-09-17T03:13:34.142680+0000","last_active":"2024-09-17T03:13:39.197849+0000","last_peered":"2024-09-17T03:13:39.197849+0000","last_clean":"2024-09-17T03:13:39.197849+0000","last_became_active":"2024-09-17T03:13:34.142375+0000","last_became_peered":"2024-09-17T03:13:34.142375+0000","last_unstale":"2024-09-17T03:13:39.197849+0000","last_undegraded":"2024-09-17T03:13:39.197849+0000","last_fullsized":"2024-09-17T03:13:39.197849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160135+0000","last_change":"2024-09-17T03:13:33.121940+0000","last_active":"2024-09-17T03:13:39.160135+0000","last_peered":"2024-09-17T03:13:39.160135+0000","last_clean":"2024-09-17T03:13:39.160135+0000","last_became_active":"2024-09-17T03:13:33.121454+0000","last_became_peered":"2024-09-17T03:13:33.121454+0000","last_unstale":"2024-09-17T03:13:39.160135+0000","last_undegraded":"2024-09-17T03:13:39.160135+0000","last_fullsized":"2024-09-17T03:13:39.160135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:43.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158537+0000","last_change":"2024-09-17T03:13:38.175006+0000","last_active":"2024-09-17T03:13:39.158537+0000","last_peered":"2024-09-17T03:13:39.158537+0000","last_clean":"2024-09-17T03:13:39.158537+0000","last_became_active":"2024-09-17T03:13:38.174354+0000","last_became_peered":"2024-09-17T03:13:38.174354+0000","last_unstale":"2024-09-17T03:13:39.158537+0000","last_undegraded":"2024-09-17T03:13:39.158537+0000","last_fullsized":"2024-09-17T03:13:39.158537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:46.350871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198197+0000","last_change":"2024-09-17T03:13:34.134217+0000","last_active":"2024-09-17T03:13:39.198197+0000","last_peered":"2024-09-17T03:13:39.198197+0000","last_clean":"2024-09-17T03:13:39.198197+0000","last_became_active":"2024-09-17T03:13:34.133864+0000","last_became_peered":"2024-09-17T03:13:34.133864+0000","last_unstale":"2024-09-17T03:13:39.198197+0000","last_undegraded":"2024-09-17T03:13:39.198197+0000","last_fullsized":"2024-09-17T03:13:39.198197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.172692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160941+0000","last_change":"2024-09-17T03:13:33.126989+0000","last_active":"2024-09-17T03:13:39.160941+0000","last_peered":"2024-09-17T03:13:39.160941+0000","last_clean":"2024-09-17T03:13:39.160941+0000","last_became_active":"2024-09-17T03:13:33.126662+0000","last_became_peered":"2024-09-17T03:13:33.126662+0000","last_unstale":"2024-09-17T03:13:39.160941+0000","last_undegraded":"2024-09-17T03:13:39.160941+0000","last_fullsized":"2024-09-17T03:13:39.160941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:08.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196440+0000","last_change":"2024-09-17T03:13:38.171271+0000","last_active":"2024-09-17T03:13:39.196440+0000","last_peered":"2024-09-17T03:13:39.196440+0000","last_clean":"2024-09-17T03:13:39.196440+0000","last_became_active":"2024-09-17T03:13:38.170206+0000","last_became_peered":"2024-09-17T03:13:38.170206+0000","last_unstale":"2024-09-17T03:13:39.196440+0000","last_undegraded":"2024-09-17T03:13:39.196440+0000","last_fullsized":"2024-09-17T03:13:39.196440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.198605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197293+0000","last_change":"2024-09-17T03:13:34.140674+0000","last_active":"2024-09-17T03:13:39.197293+0000","last_peered":"2024-09-17T03:13:39.197293+0000","last_clean":"2024-09-17T03:13:39.197293+0000","last_became_active":"2024-09-17T03:13:34.140286+0000","last_became_peered":"2024-09-17T03:13:34.140286+0000","last_unstale":"2024-09-17T03:13:39.197293+0000","last_undegraded":"2024-09-17T03:13:39.197293+0000","last_fullsized":"2024-09-17T03:13:39.197293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:16.198963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198435+0000","last_change":"2024-09-17T03:13:33.129963+0000","last_active":"2024-09-17T03:13:39.198435+0000","last_peered":"2024-09-17T03:13:39.198435+0000","last_clean":"2024-09-17T03:13:39.198435+0000","last_became_active":"2024-09-17T03:13:33.128743+0000","last_became_peered":"2024-09-17T03:13:33.128743+0000","last_unstale":"2024-09-17T03:13:39.198435+0000","last_undegraded":"2024-09-17T03:13:39.198435+0000","last_fullsized":"2024-09-17T03:13:39.198435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:59.444297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195666+0000","last_change":"2024-09-17T03:13:38.174410+0000","last_active":"2024-09-17T03:13:39.195666+0000","last_peered":"2024-09-17T03:13:39.195666+0000","last_clean":"2024-09-17T03:13:39.195666+0000","last_became_active":"2024-09-17T03:13:38.168524+0000","last_became_peered":"2024-09-17T03:13:38.168524+0000","last_unstale":"2024-09-17T03:13:39.195666+0000","last_undegraded":"2024-09-17T03:13:39.195666+0000","last_fullsized":"2024-09-17T03:13:39.195666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:11.387448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198030+0000","last_change":"2024-09-17T03:13:34.129876+0000","last_active":"2024-09-17T03:13:39.198030+0000","last_peered":"2024-09-17T03:13:39.198030+0000","last_clean":"2024-09-17T03:13:39.198030+0000","last_became_active":"2024-09-17T03:13:34.128110+0000","last_became_peered":"2024-09-17T03:13:34.128110+0000","last_unstale":"2024-09-17T03:13:39.198030+0000","last_undegraded":"2024-09-17T03:13:39.198030+0000","last_fullsized":"2024-09-17T03:13:39.198030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:04.560173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160218+0000","last_change":"2024-09-17T03:13:33.125002+0000","last_active":"2024-09-17T03:13:39.160218+0000","last_peered":"2024-09-17T03:13:39.160218+0000","last_clean":"2024-09-17T03:13:39.160218+0000","last_became_active":"2024-09-17T03:13:33.124643+0000","last_became_peered":"2024-09-17T03:13:33.124643+0000","last_unstale":"2024-09-17T03:13:39.160218+0000","last_undegraded":"2024-09-17T03:13:39.160218+0000","last_fullsized":"2024-09-17T03:13:39.160218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:42.175057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159507+0000","last_change":"2024-09-17T03:13:38.171833+0000","last_active":"2024-09-17T03:13:39.159507+0000","last_peered":"2024-09-17T03:13:39.159507+0000","last_clean":"2024-09-17T03:13:39.159507+0000","last_became_active":"2024-09-17T03:13:38.171380+0000","last_became_peered":"2024-09-17T03:13:38.171380+0000","last_unstale":"2024-09-17T03:13:39.159507+0000","last_undegraded":"2024-09-17T03:13:39.159507+0000","last_fullsized":"2024-09-17T03:13:39.159507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:43.248158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196746+0000","last_change":"2024-09-17T03:13:34.127390+0000","last_active":"2024-09-17T03:13:39.196746+0000","last_peered":"2024-09-17T03:13:39.196746+0000","last_clean":"2024-09-17T03:13:39.196746+0000","last_became_active":"2024-09-17T03:13:34.126867+0000","last_became_peered":"2024-09-17T03:13:34.126867+0000","last_unstale":"2024-09-17T03:13:39.196746+0000","last_undegraded":"2024-09-17T03:13:39.196746+0000","last_fullsized":"2024-09-17T03:13:39.196746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:45.924771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195084+0000","last_change":"2024-09-17T03:13:33.134673+0000","last_active":"2024-09-17T03:13:39.195084+0000","last_peered":"2024-09-17T03:13:39.195084+0000","last_clean":"2024-09-17T03:13:39.195084+0000","last_became_active":"2024-09-17T03:13:33.134335+0000","last_became_peered":"2024-09-17T03:13:33.134335+0000","last_unstale":"2024-09-17T03:13:39.195084+0000","last_undegraded":"2024-09-17T03:13:39.195084+0000","last_fullsized":"2024-09-17T03:13:39.195084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:19.536470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159940+0000","last_change":"2024-09-17T03:13:38.170527+0000","last_active":"2024-09-17T03:13:39.159940+0000","last_peered":"2024-09-17T03:13:39.159940+0000","last_clean":"2024-09-17T03:13:39.159940+0000","last_became_active":"2024-09-17T03:13:38.170114+0000","last_became_peered":"2024-09-17T03:13:38.170114+0000","last_unstale":"2024-09-17T03:13:39.159940+0000","last_undegraded":"2024-09-17T03:13:39.159940+0000","last_fullsized":"2024-09-17T03:13:39.159940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.118342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197562+0000","last_change":"2024-09-17T03:13:34.145344+0000","last_active":"2024-09-17T03:13:39.197562+0000","last_peered":"2024-09-17T03:13:39.197562+0000","last_clean":"2024-09-17T03:13:39.197562+0000","last_became_active":"2024-09-17T03:13:34.145041+0000","last_became_peered":"2024-09-17T03:13:34.145041+0000","last_unstale":"2024-09-17T03:13:39.197562+0000","last_undegraded":"2024-09-17T03:13:39.197562+0000","last_fullsized":"2024-09-17T03:13:39.197562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:42.312260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198728+0000","last_change":"2024-09-17T03:13:33.125668+0000","last_active":"2024-09-17T03:13:39.198728+0000","last_peered":"2024-09-17T03:13:39.198728+0000","last_clean":"2024-09-17T03:13:39.198728+0000","last_became_active":"2024-09-17T03:13:33.125357+0000","last_became_peered":"2024-09-17T03:13:33.125357+0000","last_unstale":"2024-09-17T03:13:39.198728+0000","last_undegraded":"2024-09-17T03:13:39.198728+0000","last_fullsized":"2024-09-17T03:13:39.198728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.692949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159384+0000","last_change":"2024-09-17T03:13:38.174239+0000","last_active":"2024-09-17T03:13:39.159384+0000","last_peered":"2024-09-17T03:13:39.159384+0000","last_clean":"2024-09-17T03:13:39.159384+0000","last_became_active":"2024-09-17T03:13:38.171412+0000","last_became_peered":"2024-09-17T03:13:38.171412+0000","last_unstale":"2024-09-17T03:13:39.159384+0000","last_undegraded":"2024-09-17T03:13:39.159384+0000","last_fullsized":"2024-09-17T03:13:39.159384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:06.888462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157843+0000","last_change":"2024-09-17T03:13:34.125801+0000","last_active":"2024-09-17T03:13:39.157843+0000","last_peered":"2024-09-17T03:13:39.157843+0000","last_clean":"2024-09-17T03:13:39.157843+0000","last_became_active":"2024-09-17T03:13:34.125205+0000","last_became_peered":"2024-09-17T03:13:34.125205+0000","last_unstale":"2024-09-17T03:13:39.157843+0000","last_undegraded":"2024-09-17T03:13:39.157843+0000","last_fullsized":"2024-09-17T03:13:39.157843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195177+0000","last_change":"2024-09-17T03:13:33.139264+0000","last_active":"2024-09-17T03:13:39.195177+0000","last_peered":"2024-09-17T03:13:39.195177+0000","last_clean":"2024-09-17T03:13:39.195177+0000","last_became_active":"2024-09-17T03:13:33.138945+0000","last_became_peered":"2024-09-17T03:13:33.138945+0000","last_unstale":"2024-09-17T03:13:39.195177+0000","last_undegraded":"2024-09-17T03:13:39.195177+0000","last_fullsized":"2024-09-17T03:13:39.195177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:06.266580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199260+0000","last_change":"2024-09-17T03:13:38.179790+0000","last_active":"2024-09-17T03:13:39.199260+0000","last_peered":"2024-09-17T03:13:39.199260+0000","last_clean":"2024-09-17T03:13:39.199260+0000","last_became_active":"2024-09-17T03:13:38.176965+0000","last_became_peered":"2024-09-17T03:13:38.176965+0000","last_unstale":"2024-09-17T03:13:39.199260+0000","last_undegraded":"2024-09-17T03:13:39.199260+0000","last_fullsized":"2024-09-17T03:13:39.199260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.524936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197505+0000","last_change":"2024-09-17T03:13:34.150718+0000","last_active":"2024-09-17T03:13:39.197505+0000","last_peered":"2024-09-17T03:13:39.197505+0000","last_clean":"2024-09-17T03:13:39.197505+0000","last_became_active":"2024-09-17T03:13:34.150380+0000","last_became_peered":"2024-09-17T03:13:34.150380+0000","last_unstale":"2024-09-17T03:13:39.197505+0000","last_undegraded":"2024-09-17T03:13:39.197505+0000","last_fullsized":"2024-09-17T03:13:39.197505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:45.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:47.064052+0000","last_change":"2024-09-17T03:13:33.115018+0000","last_active":"2024-09-17T03:13:47.064052+0000","last_peered":"2024-09-17T03:13:47.064052+0000","last_clean":"2024-09-17T03:13:47.064052+0000","last_became_active":"2024-09-17T03:13:33.114688+0000","last_became_peered":"2024-09-17T03:13:33.114688+0000","last_unstale":"2024-09-17T03:13:47.064052+0000","last_undegraded":"2024-09-17T03:13:47.064052+0000","last_fullsized":"2024-09-17T03:13:47.064052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:04.942641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160669+0000","last_change":"2024-09-17T03:13:38.175179+0000","last_active":"2024-09-17T03:13:39.160669+0000","last_peered":"2024-09-17T03:13:39.160669+0000","last_clean":"2024-09-17T03:13:39.160669+0000","last_became_active":"2024-09-17T03:13:38.172867+0000","last_became_peered":"2024-09-17T03:13:38.172867+0000","last_unstale":"2024-09-17T03:13:39.160669+0000","last_undegraded":"2024-09-17T03:13:39.160669+0000","last_fullsized":"2024-09-17T03:13:39.160669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:37.361119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199202+0000","last_change":"2024-09-17T03:13:34.124140+0000","last_active":"2024-09-17T03:13:39.199202+0000","last_peered":"2024-09-17T03:13:39.199202+0000","last_clean":"2024-09-17T03:13:39.199202+0000","last_became_active":"2024-09-17T03:13:34.123830+0000","last_became_peered":"2024-09-17T03:13:34.123830+0000","last_unstale":"2024-09-17T03:13:39.199202+0000","last_undegraded":"2024-09-17T03:13:39.199202+0000","last_fullsized":"2024-09-17T03:13:39.199202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:33.119048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195209+0000","last_change":"2024-09-17T03:13:33.132508+0000","last_active":"2024-09-17T03:13:39.195209+0000","last_peered":"2024-09-17T03:13:39.195209+0000","last_clean":"2024-09-17T03:13:39.195209+0000","last_became_active":"2024-09-17T03:13:33.132171+0000","last_became_peered":"2024-09-17T03:13:33.132171+0000","last_unstale":"2024-09-17T03:13:39.195209+0000","last_undegraded":"2024-09-17T03:13:39.195209+0000","last_fullsized":"2024-09-17T03:13:39.195209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:24.031412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196268+0000","last_change":"2024-09-17T03:13:38.170462+0000","last_active":"2024-09-17T03:13:39.196268+0000","last_peered":"2024-09-17T03:13:39.196268+0000","last_clean":"2024-09-17T03:13:39.196268+0000","last_became_active":"2024-09-17T03:13:38.169604+0000","last_became_peered":"2024-09-17T03:13:38.169604+0000","last_unstale":"2024-09-17T03:13:39.196268+0000","last_undegraded":"2024-09-17T03:13:39.196268+0000","last_fullsized":"2024-09-17T03:13:39.196268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:40.905174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160025+0000","last_change":"2024-09-17T03:13:34.128238+0000","last_active":"2024-09-17T03:13:39.160025+0000","last_peered":"2024-09-17T03:13:39.160025+0000","last_clean":"2024-09-17T03:13:39.160025+0000","last_became_active":"2024-09-17T03:13:34.127900+0000","last_became_peered":"2024-09-17T03:13:34.127900+0000","last_unstale":"2024-09-17T03:13:39.160025+0000","last_undegraded":"2024-09-17T03:13:39.160025+0000","last_fullsized":"2024-09-17T03:13:39.160025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197209+0000","last_change":"2024-09-17T03:13:33.133386+0000","last_active":"2024-09-17T03:13:39.197209+0000","last_peered":"2024-09-17T03:13:39.197209+0000","last_clean":"2024-09-17T03:13:39.197209+0000","last_became_active":"2024-09-17T03:13:33.132496+0000","last_became_peered":"2024-09-17T03:13:33.132496+0000","last_unstale":"2024-09-17T03:13:39.197209+0000","last_undegraded":"2024-09-17T03:13:39.197209+0000","last_fullsized":"2024-09-17T03:13:39.197209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:53.591978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194730+0000","last_change":"2024-09-17T03:13:38.176141+0000","last_active":"2024-09-17T03:13:39.194730+0000","last_peered":"2024-09-17T03:13:39.194730+0000","last_clean":"2024-09-17T03:13:39.194730+0000","last_became_active":"2024-09-17T03:13:38.175441+0000","last_became_peered":"2024-09-17T03:13:38.175441+0000","last_unstale":"2024-09-17T03:13:39.194730+0000","last_undegraded":"2024-09-17T03:13:39.194730+0000","last_fullsized":"2024-09-17T03:13:39.194730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:24.880933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197192+0000","last_change":"2024-09-17T03:13:34.127326+0000","last_active":"2024-09-17T03:13:39.197192+0000","last_peered":"2024-09-17T03:13:39.197192+0000","last_clean":"2024-09-17T03:13:39.197192+0000","last_became_active":"2024-09-17T03:13:34.126960+0000","last_became_peered":"2024-09-17T03:13:34.126960+0000","last_unstale":"2024-09-17T03:13:39.197192+0000","last_undegraded":"2024-09-17T03:13:39.197192+0000","last_fullsized":"2024-09-17T03:13:39.197192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:05.699702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197544+0000","last_change":"2024-09-17T03:13:33.127320+0000","last_active":"2024-09-17T03:13:39.197544+0000","last_peered":"2024-09-17T03:13:39.197544+0000","last_clean":"2024-09-17T03:13:39.197544+0000","last_became_active":"2024-09-17T03:13:33.126979+0000","last_became_peered":"2024-09-17T03:13:33.126979+0000","last_unstale":"2024-09-17T03:13:39.197544+0000","last_undegraded":"2024-09-17T03:13:39.197544+0000","last_fullsized":"2024-09-17T03:13:39.197544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160474+0000","last_change":"2024-09-17T03:13:38.170474+0000","last_active":"2024-09-17T03:13:39.160474+0000","last_peered":"2024-09-17T03:13:39.160474+0000","last_clean":"2024-09-17T03:13:39.160474+0000","last_became_active":"2024-09-17T03:13:38.169227+0000","last_became_peered":"2024-09-17T03:13:38.169227+0000","last_unstale":"2024-09-17T03:13:39.160474+0000","last_undegraded":"2024-09-17T03:13:39.160474+0000","last_fullsized":"2024-09-17T03:13:39.160474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:39.513902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160847+0000","last_change":"2024-09-17T03:13:38.173752+0000","last_active":"2024-09-17T03:13:39.160847+0000","last_peered":"2024-09-17T03:13:39.160847+0000","last_clean":"2024-09-17T03:13:39.160847+0000","last_became_active":"2024-09-17T03:13:38.173339+0000","last_became_peered":"2024-09-17T03:13:38.173339+0000","last_unstale":"2024-09-17T03:13:39.160847+0000","last_undegraded":"2024-09-17T03:13:39.160847+0000","last_fullsized":"2024-09-17T03:13:39.160847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:49.042265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161197+0000","last_change":"2024-09-17T03:13:34.128858+0000","last_active":"2024-09-17T03:13:39.161197+0000","last_peered":"2024-09-17T03:13:39.161197+0000","last_clean":"2024-09-17T03:13:39.161197+0000","last_became_active":"2024-09-17T03:13:34.128470+0000","last_became_peered":"2024-09-17T03:13:34.128470+0000","last_unstale":"2024-09-17T03:13:39.161197+0000","last_undegraded":"2024-09-17T03:13:39.161197+0000","last_fullsized":"2024-09-17T03:13:39.161197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:20.842323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196620+0000","last_change":"2024-09-17T03:13:33.123650+0000","last_active":"2024-09-17T03:13:39.196620+0000","last_peered":"2024-09-17T03:13:39.196620+0000","last_clean":"2024-09-17T03:13:39.196620+0000","last_became_active":"2024-09-17T03:13:33.123336+0000","last_became_peered":"2024-09-17T03:13:33.123336+0000","last_unstale":"2024-09-17T03:13:39.196620+0000","last_undegraded":"2024-09-17T03:13:39.196620+0000","last_fullsized":"2024-09-17T03:13:39.196620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:22.478021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199452+0000","last_change":"2024-09-17T03:13:38.186350+0000","last_active":"2024-09-17T03:13:39.199452+0000","last_peered":"2024-09-17T03:13:39.199452+0000","last_clean":"2024-09-17T03:13:39.199452+0000","last_became_active":"2024-09-17T03:13:38.185605+0000","last_became_peered":"2024-09-17T03:13:38.185605+0000","last_unstale":"2024-09-17T03:13:39.199452+0000","last_undegraded":"2024-09-17T03:13:39.199452+0000","last_fullsized":"2024-09-17T03:13:39.199452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:12.065538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157345+0000","last_change":"2024-09-17T03:13:34.125368+0000","last_active":"2024-09-17T03:13:39.157345+0000","last_peered":"2024-09-17T03:13:39.157345+0000","last_clean":"2024-09-17T03:13:39.157345+0000","last_became_active":"2024-09-17T03:13:34.124883+0000","last_became_peered":"2024-09-17T03:13:34.124883+0000","last_unstale":"2024-09-17T03:13:39.157345+0000","last_undegraded":"2024-09-17T03:13:39.157345+0000","last_fullsized":"2024-09-17T03:13:39.157345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158046+0000","last_change":"2024-09-17T03:13:33.128441+0000","last_active":"2024-09-17T03:13:39.158046+0000","last_peered":"2024-09-17T03:13:39.158046+0000","last_clean":"2024-09-17T03:13:39.158046+0000","last_became_active":"2024-09-17T03:13:33.128152+0000","last_became_peered":"2024-09-17T03:13:33.128152+0000","last_unstale":"2024-09-17T03:13:39.158046+0000","last_undegraded":"2024-09-17T03:13:39.158046+0000","last_fullsized":"2024-09-17T03:13:39.158046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:06.006592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198671+0000","last_change":"2024-09-17T03:13:33.128570+0000","last_active":"2024-09-17T03:13:39.198671+0000","last_peered":"2024-09-17T03:13:39.198671+0000","last_clean":"2024-09-17T03:13:39.198671+0000","last_became_active":"2024-09-17T03:13:33.128178+0000","last_became_peered":"2024-09-17T03:13:33.128178+0000","last_unstale":"2024-09-17T03:13:39.198671+0000","last_undegraded":"2024-09-17T03:13:39.198671+0000","last_fullsized":"2024-09-17T03:13:39.198671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.359407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160314+0000","last_change":"2024-09-17T03:13:34.136349+0000","last_active":"2024-09-17T03:13:39.160314+0000","last_peered":"2024-09-17T03:13:39.160314+0000","last_clean":"2024-09-17T03:13:39.160314+0000","last_became_active":"2024-09-17T03:13:34.135978+0000","last_became_peered":"2024-09-17T03:13:34.135978+0000","last_unstale":"2024-09-17T03:13:39.160314+0000","last_undegraded":"2024-09-17T03:13:39.160314+0000","last_fullsized":"2024-09-17T03:13:39.160314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:08.375730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.161237+0000","last_change":"2024-09-17T03:13:38.179343+0000","last_active":"2024-09-17T03:13:39.161237+0000","last_peered":"2024-09-17T03:13:39.161237+0000","last_clean":"2024-09-17T03:13:39.161237+0000","last_became_active":"2024-09-17T03:13:38.178868+0000","last_became_peered":"2024-09-17T03:13:38.178868+0000","last_unstale":"2024-09-17T03:13:39.161237+0000","last_undegraded":"2024-09-17T03:13:39.161237+0000","last_fullsized":"2024-09-17T03:13:39.161237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:58.731297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158741+0000","last_change":"2024-09-17T03:13:33.126321+0000","last_active":"2024-09-17T03:13:39.158741+0000","last_peered":"2024-09-17T03:13:39.158741+0000","last_clean":"2024-09-17T03:13:39.158741+0000","last_became_active":"2024-09-17T03:13:33.124412+0000","last_became_peered":"2024-09-17T03:13:33.124412+0000","last_unstale":"2024-09-17T03:13:39.158741+0000","last_undegraded":"2024-09-17T03:13:39.158741+0000","last_fullsized":"2024-09-17T03:13:39.158741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:32.084221+0000","last_clean_scrub_stamp":"2024-09-17T03:13:32.084221+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:22.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196954+0000","last_change":"2024-09-17T03:13:34.126417+0000","last_active":"2024-09-17T03:13:39.196954+0000","last_peered":"2024-09-17T03:13:39.196954+0000","last_clean":"2024-09-17T03:13:39.196954+0000","last_became_active":"2024-09-17T03:13:34.126094+0000","last_became_peered":"2024-09-17T03:13:34.126094+0000","last_unstale":"2024-09-17T03:13:39.196954+0000","last_undegraded":"2024-09-17T03:13:39.196954+0000","last_fullsized":"2024-09-17T03:13:39.196954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195295+0000","last_change":"2024-09-17T03:13:38.181805+0000","last_active":"2024-09-17T03:13:39.195295+0000","last_peered":"2024-09-17T03:13:39.195295+0000","last_clean":"2024-09-17T03:13:39.195295+0000","last_became_active":"2024-09-17T03:13:38.181287+0000","last_became_peered":"2024-09-17T03:13:38.181287+0000","last_unstale":"2024-09-17T03:13:39.195295+0000","last_undegraded":"2024-09-17T03:13:39.195295+0000","last_fullsized":"2024-09-17T03:13:39.195295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:37.130667+0000","last_clean_scrub_stamp":"2024-09-17T03:13:37.130667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:17.193253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194766+0000","last_change":"2024-09-17T03:13:34.125233+0000","last_active":"2024-09-17T03:13:39.194766+0000","last_peered":"2024-09-17T03:13:39.194766+0000","last_clean":"2024-09-17T03:13:39.194766+0000","last_became_active":"2024-09-17T03:13:34.115962+0000","last_became_peered":"2024-09-17T03:13:34.115962+0000","last_unstale":"2024-09-17T03:13:39.194766+0000","last_undegraded":"2024-09-17T03:13:39.194766+0000","last_fullsized":"2024-09-17T03:13:39.194766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194622+0000","last_change":"2024-09-17T03:13:34.142202+0000","last_active":"2024-09-17T03:13:39.194622+0000","last_peered":"2024-09-17T03:13:39.194622+0000","last_clean":"2024-09-17T03:13:39.194622+0000","last_became_active":"2024-09-17T03:13:34.141894+0000","last_became_peered":"2024-09-17T03:13:34.141894+0000","last_unstale":"2024-09-17T03:13:39.194622+0000","last_undegraded":"2024-09-17T03:13:39.194622+0000","last_fullsized":"2024-09-17T03:13:39.194622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.485857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198442+0000","last_change":"2024-09-17T03:13:34.128354+0000","last_active":"2024-09-17T03:13:39.198442+0000","last_peered":"2024-09-17T03:13:39.198442+0000","last_clean":"2024-09-17T03:13:39.198442+0000","last_became_active":"2024-09-17T03:13:34.128064+0000","last_became_peered":"2024-09-17T03:13:34.128064+0000","last_unstale":"2024-09-17T03:13:39.198442+0000","last_undegraded":"2024-09-17T03:13:39.198442+0000","last_fullsized":"2024-09-17T03:13:39.198442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.863558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158623+0000","last_change":"2024-09-17T03:13:34.140919+0000","last_active":"2024-09-17T03:13:39.158623+0000","last_peered":"2024-09-17T03:13:39.158623+0000","last_clean":"2024-09-17T03:13:39.158623+0000","last_became_active":"2024-09-17T03:13:34.140561+0000","last_became_peered":"2024-09-17T03:13:34.140561+0000","last_unstale":"2024-09-17T03:13:39.158623+0000","last_undegraded":"2024-09-17T03:13:39.158623+0000","last_fullsized":"2024-09-17T03:13:39.158623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.397850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159371+0000","last_change":"2024-09-17T03:13:34.137429+0000","last_active":"2024-09-17T03:13:39.159371+0000","last_peered":"2024-09-17T03:13:39.159371+0000","last_clean":"2024-09-17T03:13:39.159371+0000","last_became_active":"2024-09-17T03:13:34.135149+0000","last_became_peered":"2024-09-17T03:13:34.135149+0000","last_unstale":"2024-09-17T03:13:39.159371+0000","last_undegraded":"2024-09-17T03:13:39.159371+0000","last_fullsized":"2024-09-17T03:13:39.159371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.423466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158439+0000","last_change":"2024-09-17T03:13:34.144580+0000","last_active":"2024-09-17T03:13:39.158439+0000","last_peered":"2024-09-17T03:13:39.158439+0000","last_clean":"2024-09-17T03:13:39.158439+0000","last_became_active":"2024-09-17T03:13:34.144100+0000","last_became_peered":"2024-09-17T03:13:34.144100+0000","last_unstale":"2024-09-17T03:13:39.158439+0000","last_undegraded":"2024-09-17T03:13:39.158439+0000","last_fullsized":"2024-09-17T03:13:39.158439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.561070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197089+0000","last_change":"2024-09-17T03:13:34.132354+0000","last_active":"2024-09-17T03:13:39.197089+0000","last_peered":"2024-09-17T03:13:39.197089+0000","last_clean":"2024-09-17T03:13:39.197089+0000","last_became_active":"2024-09-17T03:13:34.131250+0000","last_became_peered":"2024-09-17T03:13:34.131250+0000","last_unstale":"2024-09-17T03:13:39.197089+0000","last_undegraded":"2024-09-17T03:13:39.197089+0000","last_fullsized":"2024-09-17T03:13:39.197089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:41.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159577+0000","last_change":"2024-09-17T03:13:34.134701+0000","last_active":"2024-09-17T03:13:39.159577+0000","last_peered":"2024-09-17T03:13:39.159577+0000","last_clean":"2024-09-17T03:13:39.159577+0000","last_became_active":"2024-09-17T03:13:34.134341+0000","last_became_peered":"2024-09-17T03:13:34.134341+0000","last_unstale":"2024-09-17T03:13:39.159577+0000","last_undegraded":"2024-09-17T03:13:39.159577+0000","last_fullsized":"2024-09-17T03:13:39.159577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:36.866564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196579+0000","last_change":"2024-09-17T03:13:34.128615+0000","last_active":"2024-09-17T03:13:39.196579+0000","last_peered":"2024-09-17T03:13:39.196579+0000","last_clean":"2024-09-17T03:13:39.196579+0000","last_became_active":"2024-09-17T03:13:34.128116+0000","last_became_peered":"2024-09-17T03:13:34.128116+0000","last_unstale":"2024-09-17T03:13:39.196579+0000","last_undegraded":"2024-09-17T03:13:39.196579+0000","last_fullsized":"2024-09-17T03:13:39.196579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:01.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157351+0000","last_change":"2024-09-17T03:13:34.134305+0000","last_active":"2024-09-17T03:13:39.157351+0000","last_peered":"2024-09-17T03:13:39.157351+0000","last_clean":"2024-09-17T03:13:39.157351+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.157351+0000","last_undegraded":"2024-09-17T03:13:39.157351+0000","last_fullsized":"2024-09-17T03:13:39.157351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:44.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196833+0000","last_change":"2024-09-17T03:13:34.138279+0000","last_active":"2024-09-17T03:13:39.196833+0000","last_peered":"2024-09-17T03:13:39.196833+0000","last_clean":"2024-09-17T03:13:39.196833+0000","last_became_active":"2024-09-17T03:13:34.137706+0000","last_became_peered":"2024-09-17T03:13:34.137706+0000","last_unstale":"2024-09-17T03:13:39.196833+0000","last_undegraded":"2024-09-17T03:13:39.196833+0000","last_fullsized":"2024-09-17T03:13:39.196833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:02.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.160062+0000","last_change":"2024-09-17T03:13:34.125660+0000","last_active":"2024-09-17T03:13:39.160062+0000","last_peered":"2024-09-17T03:13:39.160062+0000","last_clean":"2024-09-17T03:13:39.160062+0000","last_became_active":"2024-09-17T03:13:34.121581+0000","last_became_peered":"2024-09-17T03:13:34.121581+0000","last_unstale":"2024-09-17T03:13:39.160062+0000","last_undegraded":"2024-09-17T03:13:39.160062+0000","last_fullsized":"2024-09-17T03:13:39.160062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:13.154642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197789+0000","last_change":"2024-09-17T03:13:34.151296+0000","last_active":"2024-09-17T03:13:39.197789+0000","last_peered":"2024-09-17T03:13:39.197789+0000","last_clean":"2024-09-17T03:13:39.197789+0000","last_became_active":"2024-09-17T03:13:34.150833+0000","last_became_peered":"2024-09-17T03:13:34.150833+0000","last_unstale":"2024-09-17T03:13:39.197789+0000","last_undegraded":"2024-09-17T03:13:39.197789+0000","last_fullsized":"2024-09-17T03:13:39.197789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199481+0000","last_change":"2024-09-17T03:13:34.135844+0000","last_active":"2024-09-17T03:13:39.199481+0000","last_peered":"2024-09-17T03:13:39.199481+0000","last_clean":"2024-09-17T03:13:39.199481+0000","last_became_active":"2024-09-17T03:13:34.135484+0000","last_became_peered":"2024-09-17T03:13:34.135484+0000","last_unstale":"2024-09-17T03:13:39.199481+0000","last_undegraded":"2024-09-17T03:13:39.199481+0000","last_fullsized":"2024-09-17T03:13:39.199481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:39.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195346+0000","last_change":"2024-09-17T03:13:34.147615+0000","last_active":"2024-09-17T03:13:39.195346+0000","last_peered":"2024-09-17T03:13:39.195346+0000","last_clean":"2024-09-17T03:13:39.195346+0000","last_became_active":"2024-09-17T03:13:34.147373+0000","last_became_peered":"2024-09-17T03:13:34.147373+0000","last_unstale":"2024-09-17T03:13:39.195346+0000","last_undegraded":"2024-09-17T03:13:39.195346+0000","last_fullsized":"2024-09-17T03:13:39.195346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:00.452132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.199570+0000","last_change":"2024-09-17T03:13:34.145347+0000","last_active":"2024-09-17T03:13:39.199570+0000","last_peered":"2024-09-17T03:13:39.199570+0000","last_clean":"2024-09-17T03:13:39.199570+0000","last_became_active":"2024-09-17T03:13:34.145057+0000","last_became_peered":"2024-09-17T03:13:34.145057+0000","last_unstale":"2024-09-17T03:13:39.199570+0000","last_undegraded":"2024-09-17T03:13:39.199570+0000","last_fullsized":"2024-09-17T03:13:39.199570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:29.288163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196508+0000","last_change":"2024-09-17T03:13:34.127450+0000","last_active":"2024-09-17T03:13:39.196508+0000","last_peered":"2024-09-17T03:13:39.196508+0000","last_clean":"2024-09-17T03:13:39.196508+0000","last_became_active":"2024-09-17T03:13:34.127169+0000","last_became_peered":"2024-09-17T03:13:34.127169+0000","last_unstale":"2024-09-17T03:13:39.196508+0000","last_undegraded":"2024-09-17T03:13:39.196508+0000","last_fullsized":"2024-09-17T03:13:39.196508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:33.322508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157187+0000","last_change":"2024-09-17T03:13:34.148947+0000","last_active":"2024-09-17T03:13:39.157187+0000","last_peered":"2024-09-17T03:13:39.157187+0000","last_clean":"2024-09-17T03:13:39.157187+0000","last_became_active":"2024-09-17T03:13:34.148584+0000","last_became_peered":"2024-09-17T03:13:34.148584+0000","last_unstale":"2024-09-17T03:13:39.157187+0000","last_undegraded":"2024-09-17T03:13:39.157187+0000","last_fullsized":"2024-09-17T03:13:39.157187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:28.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157720+0000","last_change":"2024-09-17T03:13:34.138509+0000","last_active":"2024-09-17T03:13:39.157720+0000","last_peered":"2024-09-17T03:13:39.157720+0000","last_clean":"2024-09-17T03:13:39.157720+0000","last_became_active":"2024-09-17T03:13:34.137862+0000","last_became_peered":"2024-09-17T03:13:34.137862+0000","last_unstale":"2024-09-17T03:13:39.157720+0000","last_undegraded":"2024-09-17T03:13:39.157720+0000","last_fullsized":"2024-09-17T03:13:39.157720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.125892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.158457+0000","last_change":"2024-09-17T03:13:34.148276+0000","last_active":"2024-09-17T03:13:39.158457+0000","last_peered":"2024-09-17T03:13:39.158457+0000","last_clean":"2024-09-17T03:13:39.158457+0000","last_became_active":"2024-09-17T03:13:34.148053+0000","last_became_peered":"2024-09-17T03:13:34.148053+0000","last_unstale":"2024-09-17T03:13:39.158457+0000","last_undegraded":"2024-09-17T03:13:39.158457+0000","last_fullsized":"2024-09-17T03:13:39.158457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:23.791285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197786+0000","last_change":"2024-09-17T03:13:34.151106+0000","last_active":"2024-09-17T03:13:39.197786+0000","last_peered":"2024-09-17T03:13:39.197786+0000","last_clean":"2024-09-17T03:13:39.197786+0000","last_became_active":"2024-09-17T03:13:34.150584+0000","last_became_peered":"2024-09-17T03:13:34.150584+0000","last_unstale":"2024-09-17T03:13:39.197786+0000","last_undegraded":"2024-09-17T03:13:39.197786+0000","last_fullsized":"2024-09-17T03:13:39.197786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:11.890092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197394+0000","last_change":"2024-09-17T03:13:34.141641+0000","last_active":"2024-09-17T03:13:39.197394+0000","last_peered":"2024-09-17T03:13:39.197394+0000","last_clean":"2024-09-17T03:13:39.197394+0000","last_became_active":"2024-09-17T03:13:34.141338+0000","last_became_peered":"2024-09-17T03:13:34.141338+0000","last_unstale":"2024-09-17T03:13:39.197394+0000","last_undegraded":"2024-09-17T03:13:39.197394+0000","last_fullsized":"2024-09-17T03:13:39.197394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:35.475292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197098+0000","last_change":"2024-09-17T03:13:34.150804+0000","last_active":"2024-09-17T03:13:39.197098+0000","last_peered":"2024-09-17T03:13:39.197098+0000","last_clean":"2024-09-17T03:13:39.197098+0000","last_became_active":"2024-09-17T03:13:34.150486+0000","last_became_peered":"2024-09-17T03:13:34.150486+0000","last_unstale":"2024-09-17T03:13:39.197098+0000","last_undegraded":"2024-09-17T03:13:39.197098+0000","last_fullsized":"2024-09-17T03:13:39.197098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:18.029333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.197517+0000","last_change":"2024-09-17T03:13:34.131477+0000","last_active":"2024-09-17T03:13:39.197517+0000","last_peered":"2024-09-17T03:13:39.197517+0000","last_clean":"2024-09-17T03:13:39.197517+0000","last_became_active":"2024-09-17T03:13:34.130564+0000","last_became_peered":"2024-09-17T03:13:34.130564+0000","last_unstale":"2024-09-17T03:13:39.197517+0000","last_undegraded":"2024-09-17T03:13:39.197517+0000","last_fullsized":"2024-09-17T03:13:39.197517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:34.945619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.157103+0000","last_change":"2024-09-17T03:13:34.142799+0000","last_active":"2024-09-17T03:13:39.157103+0000","last_peered":"2024-09-17T03:13:39.157103+0000","last_clean":"2024-09-17T03:13:39.157103+0000","last_became_active":"2024-09-17T03:13:34.142494+0000","last_became_peered":"2024-09-17T03:13:34.142494+0000","last_unstale":"2024-09-17T03:13:39.157103+0000","last_undegraded":"2024-09-17T03:13:39.157103+0000","last_fullsized":"2024-09-17T03:13:39.157103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.778912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.194970+0000","last_change":"2024-09-17T03:13:34.141400+0000","last_active":"2024-09-17T03:13:39.194970+0000","last_peered":"2024-09-17T03:13:39.194970+0000","last_clean":"2024-09-17T03:13:39.194970+0000","last_became_active":"2024-09-17T03:13:34.141088+0000","last_became_peered":"2024-09-17T03:13:34.141088+0000","last_unstale":"2024-09-17T03:13:39.194970+0000","last_undegraded":"2024-09-17T03:13:39.194970+0000","last_fullsized":"2024-09-17T03:13:39.194970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:34.516649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196351+0000","last_change":"2024-09-17T03:13:34.118085+0000","last_active":"2024-09-17T03:13:39.196351+0000","last_peered":"2024-09-17T03:13:39.196351+0000","last_clean":"2024-09-17T03:13:39.196351+0000","last_became_active":"2024-09-17T03:13:34.117665+0000","last_became_peered":"2024-09-17T03:13:34.117665+0000","last_unstale":"2024-09-17T03:13:39.196351+0000","last_undegraded":"2024-09-17T03:13:39.196351+0000","last_fullsized":"2024-09-17T03:13:39.196351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:31.700785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.196520+0000","last_change":"2024-09-17T03:13:34.134663+0000","last_active":"2024-09-17T03:13:39.196520+0000","last_peered":"2024-09-17T03:13:39.196520+0000","last_clean":"2024-09-17T03:13:39.196520+0000","last_became_active":"2024-09-17T03:13:34.133959+0000","last_became_peered":"2024-09-17T03:13:34.133959+0000","last_unstale":"2024-09-17T03:13:39.196520+0000","last_undegraded":"2024-09-17T03:13:39.196520+0000","last_fullsized":"2024-09-17T03:13:39.196520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:54.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.195773+0000","last_change":"2024-09-17T03:13:34.116909+0000","last_active":"2024-09-17T03:13:39.195773+0000","last_peered":"2024-09-17T03:13:39.195773+0000","last_clean":"2024-09-17T03:13:39.195773+0000","last_became_active":"2024-09-17T03:13:34.115590+0000","last_became_peered":"2024-09-17T03:13:34.115590+0000","last_unstale":"2024-09-17T03:13:39.195773+0000","last_undegraded":"2024-09-17T03:13:39.195773+0000","last_fullsized":"2024-09-17T03:13:39.195773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.277899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159836+0000","last_change":"2024-09-17T03:13:34.135845+0000","last_active":"2024-09-17T03:13:39.159836+0000","last_peered":"2024-09-17T03:13:39.159836+0000","last_clean":"2024-09-17T03:13:39.159836+0000","last_became_active":"2024-09-17T03:13:34.135526+0000","last_became_peered":"2024-09-17T03:13:34.135526+0000","last_unstale":"2024-09-17T03:13:39.159836+0000","last_undegraded":"2024-09-17T03:13:39.159836+0000","last_fullsized":"2024-09-17T03:13:39.159836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:22.140373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.159196+0000","last_change":"2024-09-17T03:13:34.136523+0000","last_active":"2024-09-17T03:13:39.159196+0000","last_peered":"2024-09-17T03:13:39.159196+0000","last_clean":"2024-09-17T03:13:39.159196+0000","last_became_active":"2024-09-17T03:13:34.136202+0000","last_became_peered":"2024-09-17T03:13:34.136202+0000","last_unstale":"2024-09-17T03:13:39.159196+0000","last_undegraded":"2024-09-17T03:13:39.159196+0000","last_fullsized":"2024-09-17T03:13:39.159196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.532748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T03:13:39.198096+0000","last_change":"2024-09-17T03:13:34.145425+0000","last_active":"2024-09-17T03:13:39.198096+0000","last_peered":"2024-09-17T03:13:39.198096+0000","last_clean":"2024-09-17T03:13:39.198096+0000","last_became_active":"2024-09-17T03:13:34.144888+0000","last_became_peered":"2024-09-17T03:13:34.144888+0000","last_unstale":"2024-09-17T03:13:39.198096+0000","last_undegraded":"2024-09-17T03:13:39.198096+0000","last_fullsized":"2024-09-17T03:13:39.198096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:33.092056+0000","last_clean_scrub_stamp":"2024-09-17T03:13:33.092056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:27.730632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":701897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":112019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":282624,"data_stored":111437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:59.381 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:13:59.381 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T03:13:59.381 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T03:13:59.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 -- 172.21.15.153:0/1081216265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415b9f0 msgr2=0x7f5a340cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 --2- 172.21.15.153:0/1081216265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415b9f0 0x7f5a340cf930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005fd0 tx=0x7f5a2402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 -- 172.21.15.153:0/1081216265 shutdown_connections 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 --2- 172.21.15.153:0/1081216265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a3415f5a0 0x7f5a3415f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 --2- 172.21.15.153:0/1081216265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415b9f0 0x7f5a340cf930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.636+0000 7f5a39a00640 1 -- 172.21.15.153:0/1081216265 >> 172.21.15.153:0/1081216265 conn(0x7f5a340cca40 msgr2=0x7f5a340cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.637+0000 7f5a39a00640 1 -- 172.21.15.153:0/1081216265 shutdown_connections 2024-09-17T03:13:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.637+0000 7f5a39a00640 1 -- 172.21.15.153:0/1081216265 wait complete. 2024-09-17T03:13:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.639+0000 7f5a39a00640 1 Processor -- start 2024-09-17T03:13:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.639+0000 7f5a39a00640 1 -- start start 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a340cefa0 0x7f5a340c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a3415b9f0 0x7f5a340c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3406df70 con 0x7f5a3415f5a0 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3406ddf0 con 0x7f5a3415b9f0 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.640+0000 7f5a39a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3406e0f0 con 0x7f5a340cefa0 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56516/0 (socket says 172.21.15.153:56516) 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 -- 172.21.15.153:0/3268964260 learned_addr learned my addr 172.21.15.153:0/3268964260 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a32a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a340cefa0 0x7f5a340c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a2be00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a3415b9f0 0x7f5a340c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 -- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a340cefa0 msgr2=0x7f5a340c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a340cefa0 0x7f5a340c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 -- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a3415b9f0 msgr2=0x7f5a340c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a3415b9f0 0x7f5a340c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 -- 172.21.15.153:0/3268964260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a340c94b0 con 0x7f5a3415f5a0 2024-09-17T03:13:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.641+0000 7f5a33400640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ea70 tx=0x7f5a2c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.642+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00ce40 con 0x7f5a3415f5a0 2024-09-17T03:13:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.642+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a2c004c10 con 0x7f5a3415f5a0 2024-09-17T03:13:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.642+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a340c2f50 con 0x7f5a3415f5a0 2024-09-17T03:13:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.642+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c005020 con 0x7f5a3415f5a0 2024-09-17T03:13:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.642+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a340c99a0 con 0x7f5a3415f5a0 2024-09-17T03:13:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.643+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a340c9220 con 0x7f5a3415f5a0 2024-09-17T03:13:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.644+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a2c0051c0 con 0x7f5a3415f5a0 2024-09-17T03:13:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.645+0000 7f5a2aa00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 0x7f5a1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.646+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5a2c09bee0 con 0x7f5a3415f5a0 2024-09-17T03:13:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.646+0000 7f5a32a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 0x7f5a1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.647+0000 7f5a32a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 0x7f5a1007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a24033000 tx=0x7f5a24004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.650+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a2c0638f0 con 0x7f5a3415f5a0 2024-09-17T03:13:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.872+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a340cc420 con 0x7f5a3415f5a0 2024-09-17T03:13:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.872+0000 7f5a2aa00640 1 -- 172.21.15.153:0/3268964260 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5a340cc420 con 0x7f5a3415f5a0 2024-09-17T03:13:59.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:13:59.872 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 msgr2=0x7f5a1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 0x7f5a1007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a24033000 tx=0x7f5a24004730 comp rx=0 tx=0).stop 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 msgr2=0x7f5a340c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00ea70 tx=0x7f5a2c00ef30 comp rx=0 tx=0).stop 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 shutdown_connections 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5a10078b90 0x7f5a1007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a3415f5a0 0x7f5a340c84c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a3415b9f0 0x7f5a340c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 --2- 172.21.15.153:0/3268964260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a340cefa0 0x7f5a340c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 >> 172.21.15.153:0/3268964260 conn(0x7f5a340cca40 msgr2=0x7f5a340ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 shutdown_connections 2024-09-17T03:13:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:13:59.875+0000 7f5a39a00640 1 -- 172.21.15.153:0/3268964260 wait complete. 2024-09-17T03:13:59.899 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T03:13:59.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.122+0000 7f8e4ac00640 1 -- 172.21.15.153:0/1443047546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e44074cb0 msgr2=0x7f8e44073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/1443047546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e44074cb0 0x7f8e44073dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009830 tx=0x7f8e3402a510 comp rx=0 tx=0).stop 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 -- 172.21.15.153:0/1443047546 shutdown_connections 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/1443047546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e44074cb0 0x7f8e44073dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 -- 172.21.15.153:0/1443047546 >> 172.21.15.153:0/1443047546 conn(0x7f8e440cca40 msgr2=0x7f8e440cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 -- 172.21.15.153:0/1443047546 shutdown_connections 2024-09-17T03:14:00.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.123+0000 7f8e4ac00640 1 -- 172.21.15.153:0/1443047546 wait complete. 2024-09-17T03:14:00.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.125+0000 7f8e4ac00640 1 Processor -- start 2024-09-17T03:14:00.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.125+0000 7f8e4ac00640 1 -- start start 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.126+0000 7f8e4ac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 0x7f8e440b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.126+0000 7f8e4ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e4ac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e44154460 0x7f8e4415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e4ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4406f670 con 0x7f8e440cbc10 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e4ac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4406f4f0 con 0x7f8e44074cb0 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e4ac00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4406f7f0 con 0x7f8e44154460 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56534/0 (socket says 172.21.15.153:56534) 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 -- 172.21.15.153:0/2967884276 learned_addr learned my addr 172.21.15.153:0/2967884276 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43e00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 0x7f8e440b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e48c00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e44154460 0x7f8e4415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 -- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e44154460 msgr2=0x7f8e4415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e44154460 0x7f8e4415e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 -- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 msgr2=0x7f8e440b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 0x7f8e440b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 -- 172.21.15.153:0/2967884276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e441516d0 con 0x7f8e440cbc10 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43e00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 0x7f8e440b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.127+0000 7f8e43400640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b3e0 tx=0x7f8e3000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.128+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30015020 con 0x7f8e440cbc10 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.128+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e30011920 con 0x7f8e440cbc10 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.128+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e441519b0 con 0x7f8e440cbc10 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.128+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30011d70 con 0x7f8e440cbc10 2024-09-17T03:14:00.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.128+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e440b3f70 con 0x7f8e440cbc10 2024-09-17T03:14:00.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.129+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e440b3cb0 con 0x7f8e440cbc10 2024-09-17T03:14:00.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.130+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e30018020 con 0x7f8e440cbc10 2024-09-17T03:14:00.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.131+0000 7f8e3be00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.132+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8e3009aee0 con 0x7f8e440cbc10 2024-09-17T03:14:00.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.132+0000 7f8e43e00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.133+0000 7f8e43e00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 0x7f8e2407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e34034000 tx=0x7f8e34004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.136+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e3001f020 con 0x7f8e440cbc10 2024-09-17T03:14:00.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.366+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e44073dd0 con 0x7f8e440cbc10 2024-09-17T03:14:00.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.366+0000 7f8e3be00640 1 -- 172.21.15.153:0/2967884276 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f8e30063070 con 0x7f8e440cbc10 2024-09-17T03:14:00.366 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:00.366 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:00.366 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 msgr2=0x7f8e2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 0x7f8e2407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e34034000 tx=0x7f8e34004730 comp rx=0 tx=0).stop 2024-09-17T03:14:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 msgr2=0x7f8e441f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b3e0 tx=0x7f8e3000b8a0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 shutdown_connections 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e44154460 0x7f8e4415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e440cbc10 0x7f8e441f5270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 --2- 172.21.15.153:0/2967884276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e44074cb0 0x7f8e440b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 >> 172.21.15.153:0/2967884276 conn(0x7f8e440cca40 msgr2=0x7f8e4415ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 shutdown_connections 2024-09-17T03:14:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.369+0000 7f8e4ac00640 1 -- 172.21.15.153:0/2967884276 wait complete. 2024-09-17T03:14:00.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 -- 172.21.15.153:0/606686027 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 msgr2=0x7f1a3c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 --2- 172.21.15.153:0/606686027 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c06ddf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009860 tx=0x7f1a2802a5a0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 -- 172.21.15.153:0/606686027 shutdown_connections 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 --2- 172.21.15.153:0/606686027 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c06ddf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 -- 172.21.15.153:0/606686027 >> 172.21.15.153:0/606686027 conn(0x7f1a3c0cca40 msgr2=0x7f1a3c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:00.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 -- 172.21.15.153:0/606686027 shutdown_connections 2024-09-17T03:14:00.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.619+0000 7f1a41e00640 1 -- 172.21.15.153:0/606686027 wait complete. 2024-09-17T03:14:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.621+0000 7f1a41e00640 1 Processor -- start 2024-09-17T03:14:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.621+0000 7f1a41e00640 1 -- start start 2024-09-17T03:14:00.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.622+0000 7f1a41e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a3c06e330 0x7f1a3c0a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.622+0000 7f1a41e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c09c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.622+0000 7f1a41e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a41e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c06f670 con 0x7f1a3c074cb0 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a41e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c06f4f0 con 0x7f1a3c06e330 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a41e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3c06f7f0 con 0x7f1a3c073dd0 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56544/0 (socket says 172.21.15.153:56544) 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 -- 172.21.15.153:0/792266193 learned_addr learned my addr 172.21.15.153:0/792266193 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3aa00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a3c06e330 0x7f1a3c0a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3a000640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c09c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 -- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 msgr2=0x7f1a3c09c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c09c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 -- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a3c06e330 msgr2=0x7f1a3c0a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a3c06e330 0x7f1a3c0a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3b400640 1 -- 172.21.15.153:0/792266193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c0a0fd0 con 0x7f1a3c074cb0 2024-09-17T03:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.623+0000 7f1a3a000640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c09c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a3b400640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c680 tx=0x7f1a3400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34003b70 con 0x7f1a3c074cb0 2024-09-17T03:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a34003d30 con 0x7f1a3c074cb0 2024-09-17T03:14:00.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c09d9a0 con 0x7f1a3c074cb0 2024-09-17T03:14:00.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34005330 con 0x7f1a3c074cb0 2024-09-17T03:14:00.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.624+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c09bd30 con 0x7f1a3c074cb0 2024-09-17T03:14:00.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.625+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c15ec20 con 0x7f1a3c074cb0 2024-09-17T03:14:00.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.626+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a340054d0 con 0x7f1a3c074cb0 2024-09-17T03:14:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.627+0000 7f1a33400640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 0x7f1a1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.628+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1a3409af00 con 0x7f1a3c074cb0 2024-09-17T03:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.628+0000 7f1a3aa00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 0x7f1a1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.629+0000 7f1a3aa00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 0x7f1a1c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000c00 tx=0x7f1a2c007ec0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.632+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a3c06e740 con 0x7f1a3c074cb0 2024-09-17T03:14:00.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.861+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a3c159700 con 0x7f1a3c074cb0 2024-09-17T03:14:00.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.862+0000 7f1a33400640 1 -- 172.21.15.153:0/792266193 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f1a34062f70 con 0x7f1a3c074cb0 2024-09-17T03:14:00.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:00.861 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 msgr2=0x7f1a1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 0x7f1a1c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000c00 tx=0x7f1a2c007ec0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 msgr2=0x7f1a3c0b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c680 tx=0x7f1a3400cb40 comp rx=0 tx=0).stop 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 shutdown_connections 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1a1c078b90 0x7f1a1c07b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a3c074cb0 0x7f1a3c0b2e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a3c073dd0 0x7f1a3c09c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 --2- 172.21.15.153:0/792266193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a3c06e330 0x7f1a3c0a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 >> 172.21.15.153:0/792266193 conn(0x7f1a3c0cca40 msgr2=0x7f1a3c15f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 shutdown_connections 2024-09-17T03:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:00.865+0000 7f1a41e00640 1 -- 172.21.15.153:0/792266193 wait complete. 2024-09-17T03:14:00.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.117+0000 7f2827e00640 1 -- 172.21.15.153:0/3623477684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 msgr2=0x7f28281622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.117+0000 7f2827e00640 1 --2- 172.21.15.153:0/3623477684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281622b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2818009830 tx=0x7f281802a500 comp rx=0 tx=0).stop 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 -- 172.21.15.153:0/3623477684 shutdown_connections 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 --2- 172.21.15.153:0/3623477684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 0x7f282806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 --2- 172.21.15.153:0/3623477684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281622b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 -- 172.21.15.153:0/3623477684 >> 172.21.15.153:0/3623477684 conn(0x7f28280d1930 msgr2=0x7f28280d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 -- 172.21.15.153:0/3623477684 shutdown_connections 2024-09-17T03:14:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.118+0000 7f2827e00640 1 -- 172.21.15.153:0/3623477684 wait complete. 2024-09-17T03:14:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.120+0000 7f2827e00640 1 Processor -- start 2024-09-17T03:14:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.120+0000 7f2827e00640 1 -- start start 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f282806d7f0 0x7f28281f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 0x7f28280ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2828155940 con 0x7f28280b9e40 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f28281557c0 con 0x7f282806d7f0 2024-09-17T03:14:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2828155ac0 con 0x7f28281627f0 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56562/0 (socket says 172.21.15.153:56562) 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 -- 172.21.15.153:0/1280105428 learned_addr learned my addr 172.21.15.153:0/1280105428 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2827400640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 0x7f28280ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826a00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f282806d7f0 0x7f28281f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 -- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 msgr2=0x7f28280ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 0x7f28280ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 -- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f282806d7f0 msgr2=0x7f28281f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f282806d7f0 0x7f28281f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.122+0000 7f2826000640 1 -- 172.21.15.153:0/1280105428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28281f6020 con 0x7f28280b9e40 2024-09-17T03:14:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f2826000640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f281400e9f0 tx=0x7f281400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281400cd80 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2814004020 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28280ca6c0 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814004450 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.123+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28280cb3e0 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.124+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28281622b0 con 0x7f28280b9e40 2024-09-17T03:14:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.126+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28140035f0 con 0x7f28280b9e40 2024-09-17T03:14:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.127+0000 7f281ea00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 0x7f280807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.127+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f281409b940 con 0x7f28280b9e40 2024-09-17T03:14:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.128+0000 7f2826a00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 0x7f280807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.129+0000 7f2826a00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 0x7f280807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2818034000 tx=0x7f2818004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.132+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2814063350 con 0x7f28280b9e40 2024-09-17T03:14:01.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.323+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28280ca010 con 0x7f28280b9e40 2024-09-17T03:14:01.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.325+0000 7f281ea00640 1 -- 172.21.15.153:0/1280105428 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18638 (secure 0 0 0) 0x7f2814067d80 con 0x7f28280b9e40 2024-09-17T03:14:01.324 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:01.324 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:13:38.649131+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 msgr2=0x7f280807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 0x7f280807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2818034000 tx=0x7f2818004730 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 msgr2=0x7f28281517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f281400e9f0 tx=0x7f281400eeb0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 shutdown_connections 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2808078b90 0x7f280807b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28281627f0 0x7f28280ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28280b9e40 0x7f28281517c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 --2- 172.21.15.153:0/1280105428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f282806d7f0 0x7f28281f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 >> 172.21.15.153:0/1280105428 conn(0x7f28280d1930 msgr2=0x7f282815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 shutdown_connections 2024-09-17T03:14:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.327+0000 7f2827e00640 1 -- 172.21.15.153:0/1280105428 wait complete. 2024-09-17T03:14:01.352 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:01.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 -- 172.21.15.153:0/275449809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a006d9c0 msgr2=0x7fc4a0154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 --2- 172.21.15.153:0/275449809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a006d9c0 0x7fc4a0154ea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc498009be0 tx=0x7fc49802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 -- 172.21.15.153:0/275449809 shutdown_connections 2024-09-17T03:14:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 --2- 172.21.15.153:0/275449809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a006d9c0 0x7fc4a0154ea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 -- 172.21.15.153:0/275449809 >> 172.21.15.153:0/275449809 conn(0x7fc4a00d1930 msgr2=0x7fc4a00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 -- 172.21.15.153:0/275449809 shutdown_connections 2024-09-17T03:14:01.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.579+0000 7fc49f200640 1 -- 172.21.15.153:0/275449809 wait complete. 2024-09-17T03:14:01.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.581+0000 7fc49f200640 1 Processor -- start 2024-09-17T03:14:01.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.581+0000 7fc49f200640 1 -- start start 2024-09-17T03:14:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 0x7fc4a01e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0155560 con 0x7fc4a01e9900 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01553e0 con 0x7fc4a006d9c0 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a01556e0 con 0x7fc4a00b9e40 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 0x7fc4a01e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56568/0 (socket says 172.21.15.153:56568) 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49e800640 1 -- 172.21.15.153:0/1884540305 learned_addr learned my addr 172.21.15.153:0/1884540305 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 0x7fc4a01e93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:56768/0 (socket says 172.21.15.153:56768) 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.583+0000 7fc49de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:57412/0 (socket says 172.21.15.153:57412) 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 -- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 msgr2=0x7fc4a01e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 0x7fc4a01e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 -- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 msgr2=0x7fc4a0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 -- 172.21.15.153:0/1884540305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a00c7e10 con 0x7fc4a01e9900 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49de00640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49e800640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc498035040 tx=0x7fc498003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498042020 con 0x7fc4a01e9900 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc498033b00 con 0x7fc4a01e9900 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a00c8310 con 0x7fc4a01e9900 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.584+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037040 con 0x7fc4a01e9900 2024-09-17T03:14:01.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.585+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a00c88d0 con 0x7fc4a01e9900 2024-09-17T03:14:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.586+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a0154ea0 con 0x7fc4a01e9900 2024-09-17T03:14:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.587+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc498045020 con 0x7fc4a01e9900 2024-09-17T03:14:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.588+0000 7fc496000640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 0x7fc48007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.588+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc4980bbc00 con 0x7fc4a01e9900 2024-09-17T03:14:01.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.588+0000 7fc49de00640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 0x7fc48007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:01.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.589+0000 7fc49de00640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 0x7fc48007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4900010e0 tx=0x7fc4900018f0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.592+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc49804c030 con 0x7fc4a01e9900 2024-09-17T03:14:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.819+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a00b9560 con 0x7fc4a01e9900 2024-09-17T03:14:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.819+0000 7fc496000640 1 -- 172.21.15.153:0/1884540305 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fc498083610 con 0x7fc4a01e9900 2024-09-17T03:14:01.819 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:01.819 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:01.819 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 msgr2=0x7fc48007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 0x7fc48007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4900010e0 tx=0x7fc4900018f0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 msgr2=0x7fc4a014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc498035040 tx=0x7fc498003e70 comp rx=0 tx=0).stop 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 shutdown_connections 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc480078b90 0x7fc48007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4a01e9900 0x7fc4a014d2e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4a00b9e40 0x7fc4a01e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 --2- 172.21.15.153:0/1884540305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4a006d9c0 0x7fc4a0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 >> 172.21.15.153:0/1884540305 conn(0x7fc4a00d1930 msgr2=0x7fc4a00b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 shutdown_connections 2024-09-17T03:14:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:01.822+0000 7fc49f200640 1 -- 172.21.15.153:0/1884540305 wait complete. 2024-09-17T03:14:02.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:13:33.601612+0000', 'modified': '2024-09-17T03:13:50.699040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4371': {'gid': 4371, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6837/842621775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6835', 'nonce': 842621775}, {'type': 'v1', 'addr': '172.21.15.164:6837', 'nonce': 842621775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4371, 'qdb_cluster': [4371]} 2024-09-17T03:14:02.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:14:02.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:14:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 -- 172.21.15.153:0/2295150702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cc0e0 msgr2=0x7f58640702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 --2- 172.21.15.153:0/2295150702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cc0e0 0x7f58640702a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5854005fd0 tx=0x7f585402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 -- 172.21.15.153:0/2295150702 shutdown_connections 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 --2- 172.21.15.153:0/2295150702 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58641605f0 0x7f58640b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 --2- 172.21.15.153:0/2295150702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cc0e0 0x7f58640702a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 -- 172.21.15.153:0/2295150702 >> 172.21.15.153:0/2295150702 conn(0x7f58640d05c0 msgr2=0x7f586406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 -- 172.21.15.153:0/2295150702 shutdown_connections 2024-09-17T03:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.473+0000 7f5863200640 1 -- 172.21.15.153:0/2295150702 wait complete. 2024-09-17T03:14:02.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.475+0000 7f5863200640 1 Processor -- start 2024-09-17T03:14:02.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.475+0000 7f5863200640 1 -- start start 2024-09-17T03:14:02.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58640cc0e0 0x7f58641f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58641e7990 0x7f586413e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58640b3c90 con 0x7f58640cf6d0 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f58640b3b10 con 0x7f58641e7990 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5863200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f58640b3e10 con 0x7f58640cc0e0 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5859400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5859400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56584/0 (socket says 172.21.15.153:56584) 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5859400640 1 -- 172.21.15.153:0/2394043700 learned_addr learned my addr 172.21.15.153:0/2394043700 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5861e00640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58640cc0e0 0x7f58641f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.477+0000 7f5862800640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58641e7990 0x7f586413e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 -- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58640cc0e0 msgr2=0x7f58641f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58640cc0e0 0x7f58641f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 -- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58641e7990 msgr2=0x7f586413e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58641e7990 0x7f586413e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 -- 172.21.15.153:0/2394043700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58641f60f0 con 0x7f58640cf6d0 2024-09-17T03:14:02.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5859400640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c370 tx=0x7f584c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f585aa00640 1 -- 172.21.15.153:0/2394043700 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017070 con 0x7f58640cf6d0 2024-09-17T03:14:02.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f585aa00640 1 -- 172.21.15.153:0/2394043700 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f584c0053c0 con 0x7f58640cf6d0 2024-09-17T03:14:02.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586413dce0 con 0x7f58640cf6d0 2024-09-17T03:14:02.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f585aa00640 1 -- 172.21.15.153:0/2394043700 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c003850 con 0x7f58640cf6d0 2024-09-17T03:14:02.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.478+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58641e6eb0 con 0x7f58640cf6d0 2024-09-17T03:14:02.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.481+0000 7f585aa00640 1 -- 172.21.15.153:0/2394043700 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f584c01a070 con 0x7f58640cf6d0 2024-09-17T03:14:02.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.482+0000 7f585aa00640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.482+0000 7f585aa00640 1 -- 172.21.15.153:0/2394043700 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f584c09a3e0 con 0x7f58640cf6d0 2024-09-17T03:14:02.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.482+0000 7f58701ed740 1 Processor -- start 2024-09-17T03:14:02.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.482+0000 7f5861e00640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.482+0000 7f58701ed740 1 -- start start 2024-09-17T03:14:02.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.483+0000 7f5861e00640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5854033000 tx=0x7f5854004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95242b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e493b0 0x55bf952430a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf9519c430 con 0x55bf94e51590 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bf9518c5d0 con 0x55bf94e72270 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55bf9517ba00 con 0x55bf94e493b0 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56598/0 (socket says 172.21.15.153:56598) 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 -- 172.21.15.153:0/3581100020 learned_addr learned my addr 172.21.15.153:0/3581100020 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5861e00640 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95242b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5859400640 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e493b0 0x55bf952430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 -- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e493b0 msgr2=0x55bf952430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e493b0 0x55bf952430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 -- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 msgr2=0x55bf95242b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.484+0000 7f5862800640 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95242b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.485+0000 7f5862800640 1 -- 172.21.15.153:0/3581100020 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf95144520 con 0x55bf94e51590 2024-09-17T03:14:02.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.485+0000 7f5862800640 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f585c009f50 tx=0x7f585c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215d1f444bed052 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.485+0000 7f5852a00640 1 -- 172.21.15.153:0/3581100020 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c016070 con 0x55bf94e51590 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.485+0000 7f5852a00640 1 -- 172.21.15.153:0/3581100020 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f585c004e10 con 0x55bf94e51590 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.485+0000 7f5852a00640 1 -- 172.21.15.153:0/3581100020 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c005280 con 0x55bf94e51590 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 -- 172.21.15.153:0/3581100020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 msgr2=0x55bf95213150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f585c009f50 tx=0x7f585c010800 comp rx=0 tx=0).stop 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 -- 172.21.15.153:0/3581100020 shutdown_connections 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e51590 0x55bf95213150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e493b0 0x55bf952430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 --2- 172.21.15.153:0/3581100020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95242b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 -- 172.21.15.153:0/3581100020 >> 172.21.15.153:0/3581100020 conn(0x55bf94e663c0 msgr2=0x55bf95218b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 -- 172.21.15.153:0/3581100020 shutdown_connections 2024-09-17T03:14:02.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.486+0000 7f58701ed740 1 -- 172.21.15.153:0/3581100020 wait complete. 2024-09-17T03:14:02.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.487+0000 7f58701ed740 1 -- start start 2024-09-17T03:14:02.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.487+0000 7f58701ed740 1 Processor -- start 2024-09-17T03:14:02.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95229b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95270230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf95122330 con 0x55bf94e493b0 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bf9517f810 con 0x55bf94e72270 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55bf94eec620 con 0x55bf94e51590 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f58701ed740 10 client.0 _ll_register_callbacks cb 0x55bf95127420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f5861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f5861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56604/0 (socket says 172.21.15.153:56604) 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f5861e00640 1 -- 172.21.15.153:0/2390324085 learned_addr learned my addr 172.21.15.153:0/2390324085 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f5859400640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95229b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.489+0000 7f5862800640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95270230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 -- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 msgr2=0x55bf95229b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95229b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 -- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 msgr2=0x55bf95270230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95270230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 -- 172.21.15.153:0/2390324085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf94edd850 con 0x55bf94e493b0 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5861e00640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5854034040 tx=0x7f5854009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac95254e3570e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5847400640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:02.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854035040 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5854003d50 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f585c004e10 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f5854059050 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f58701ed740 10 client.4785 fetch_fsmap learned FSMap version 9 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.490+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf94f546b0 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f585c004e10 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f58540047a0 con 0x55bf94e493b0 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 10 client.4785 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 10 client.4785 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 20 client.4785 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:02.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf94e30e40 0x55bf9526cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 4 client.4785 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 --> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf9518e520 con 0x55bf94e30e40 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.491+0000 7f5859400640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf94e30e40 0x55bf9526cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.492+0000 7f5859400640 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf94e30e40 0x55bf9526cd40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e14b6c8cb86119c server_cookie=e2f8af7cddb32a70 in_seq=0 out_seq=0 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.492+0000 7f5847400640 10 client.4785 ms_handle_connect on v2:172.21.15.164:6835/842621775 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f5847400640 1 -- 172.21.15.153:0/2390324085 <== mds.0 v2:172.21.15.164:6835/842621775 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf9518e520 con 0x55bf94e30e40 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f5847400640 10 client.4785 handle_command_reply: tid=0 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 client.4785 shutdown 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 msgr2=0x55bf952576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5854034040 tx=0x7f5854009260 comp rx=0 tx=0).stop 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 shutdown_connections 2024-09-17T03:14:02.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf94e30e40 0x55bf9526cd40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e72270 0x55bf95270230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95229b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f5847400640 0 client.4785 ms_handle_reset on v2:172.21.15.164:6835/842621775 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 --2- 172.21.15.153:0/2390324085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf952576e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 >> 172.21.15.153:0/2390324085 conn(0x55bf94e663c0 msgr2=0x55bf95213060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 shutdown_connections 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.493+0000 7f58701ed740 1 -- 172.21.15.153:0/2390324085 wait complete. 2024-09-17T03:14:02.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.494+0000 7f58701ed740 20 client.4785 trim_cache size 0 max 16384 2024-09-17T03:14:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.512+0000 7f58701ed740 1 Processor -- start 2024-09-17T03:14:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.513+0000 7f58701ed740 1 -- start start 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e51590 0x55bf95241ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e72270 0x55bf9526cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5864202490 con 0x55bf94e493b0 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5864201820 con 0x55bf94e51590 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5864201e70 con 0x55bf94e72270 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56614/0 (socket says 172.21.15.153:56614) 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 -- 172.21.15.153:0/2426993741 learned_addr learned my addr 172.21.15.153:0/2426993741 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5862800640 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e72270 0x55bf9526cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5859400640 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e51590 0x55bf95241ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 -- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e72270 msgr2=0x55bf9526cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e72270 0x55bf9526cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 -- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e51590 msgr2=0x55bf95241ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e51590 0x55bf95241ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.514+0000 7f5861e00640 1 -- 172.21.15.153:0/2426993741 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf95229f00 con 0x55bf94e493b0 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.515+0000 7f5861e00640 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5854004960 tx=0x7f5854004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f1046e82f3906a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.515+0000 7f5852000640 1 -- 172.21.15.153:0/2426993741 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854003d50 con 0x55bf94e493b0 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.515+0000 7f5852000640 1 -- 172.21.15.153:0/2426993741 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5854003ef0 con 0x55bf94e493b0 2024-09-17T03:14:02.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.515+0000 7f5852000640 1 -- 172.21.15.153:0/2426993741 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585405e680 con 0x55bf94e493b0 2024-09-17T03:14:02.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 -- 172.21.15.153:0/2426993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 msgr2=0x55bf95241570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5854004960 tx=0x7f5854004990 comp rx=0 tx=0).stop 2024-09-17T03:14:02.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 -- 172.21.15.153:0/2426993741 shutdown_connections 2024-09-17T03:14:02.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e72270 0x55bf9526cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e51590 0x55bf95241ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 --2- 172.21.15.153:0/2426993741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e493b0 0x55bf95241570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 -- 172.21.15.153:0/2426993741 >> 172.21.15.153:0/2426993741 conn(0x55bf94e663c0 msgr2=0x55bf95218b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 -- 172.21.15.153:0/2426993741 shutdown_connections 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.516+0000 7f58701ed740 1 -- 172.21.15.153:0/2426993741 wait complete. 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.517+0000 7f58701ed740 1 -- start start 2024-09-17T03:14:02.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.517+0000 7f58701ed740 1 Processor -- start 2024-09-17T03:14:02.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e493b0 0x55bf952dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95260750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf9523c120 con 0x55bf94e72270 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bf9523bc00 con 0x55bf94e493b0 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55bf9523c710 con 0x55bf94e51590 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.518+0000 7f58701ed740 10 client.0 _ll_register_callbacks cb 0x7f58540041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5862800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5862800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56624/0 (socket says 172.21.15.153:56624) 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5861e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e493b0 0x55bf952dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95260750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5862800640 1 -- 172.21.15.153:0/118454162 learned_addr learned my addr 172.21.15.153:0/118454162 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:02.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 -- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e493b0 msgr2=0x55bf952dabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e493b0 0x55bf952dabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 -- 172.21.15.153:0/118454162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 msgr2=0x55bf95260c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 -- 172.21.15.153:0/118454162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55bf95259680 con 0x55bf94e51590 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5862800640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5859400640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95260750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f584c098500 tx=0x7f584c005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd2588c361d968d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.519+0000 7f5847400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3301/0 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c065040 con 0x55bf94e51590 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mon.2 v2:172.21.15.164:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f584c09a0b0 con 0x55bf94e51590 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5854003ef0 con 0x55bf94e51590 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f584c070050 con 0x55bf94e51590 2024-09-17T03:14:02.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 10 client.4667 fetch_fsmap learned FSMap version 9 2024-09-17T03:14:02.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf95219f00 con 0x55bf94e51590 2024-09-17T03:14:02.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mon.2 v2:172.21.15.164:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5854003ef0 con 0x55bf94e51590 2024-09-17T03:14:02.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mon.2 v2:172.21.15.164:3301/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f584c073020 con 0x55bf94e51590 2024-09-17T03:14:02.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 10 client.4667 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 10 client.4667 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 20 client.4667 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf952e1780 0x55bf95213b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 4 client.4667 mds_command: new command op to 4371 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.520+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 --> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] -- command(tid 0: {"prefix": "status"}) -- 0x55bf95189fd0 con 0x55bf952e1780 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.521+0000 7f5861e00640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf952e1780 0x55bf95213b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.521+0000 7f5847400640 10 client.4667 ms_handle_connect on v2:172.21.15.164:6835/842621775 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.521+0000 7f5861e00640 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf952e1780 0x55bf95213b70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f672fca01686e server_cookie=608d53d83ac36fb8 in_seq=0 out_seq=0 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f5847400640 1 -- 172.21.15.153:0/118454162 <== mds.0 v2:172.21.15.164:6835/842621775 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55bf95189fd0 con 0x55bf952e1780 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f5847400640 10 client.4667 handle_command_reply: tid=0 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 client.4667 shutdown 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 msgr2=0x55bf95260750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95260750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f584c098500 tx=0x7f584c005040 comp rx=0 tx=0).stop 2024-09-17T03:14:02.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 shutdown_connections 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:6835/842621775,v1:172.21.15.164:6837/842621775] conn(0x55bf952e1780 0x55bf95213b70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf94e72270 0x55bf95260c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55bf94e51590 0x55bf95260750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 --2- 172.21.15.153:0/118454162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bf94e493b0 0x55bf952dabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f5847400640 0 client.4667 ms_handle_reset on v2:172.21.15.164:6835/842621775 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 >> 172.21.15.153:0/118454162 conn(0x55bf94e663c0 msgr2=0x55bf95258660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 shutdown_connections 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 1 -- 172.21.15.153:0/118454162 wait complete. 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.522+0000 7f58701ed740 20 client.4667 trim_cache size 0 max 16384 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:14:02.524 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4371, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 28.420515907999999, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 9, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 27, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 27, 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 34.448502728999998 2024-09-17T03:14:02.525 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:14:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 msgr2=0x7f584007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5854033000 tx=0x7f5854004730 comp rx=0 tx=0).stop 2024-09-17T03:14:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 msgr2=0x7f586413d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c370 tx=0x7f584c00c830 comp rx=0 tx=0).stop 2024-09-17T03:14:02.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 shutdown_connections 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58641e7990 0x7f586413e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58640cf6d0 0x7f586413d7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 --2- 172.21.15.153:0/2394043700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58640cc0e0 0x7f58641f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 >> 172.21.15.153:0/2394043700 conn(0x7f58640d05c0 msgr2=0x7f586406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 shutdown_connections 2024-09-17T03:14:02.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:02.523+0000 7f5863200640 1 -- 172.21.15.153:0/2394043700 wait complete. 2024-09-17T03:14:02.543 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T03:14:02.562 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T03:14:02.562 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T03:14:02.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:02.562 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:14:02.597 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-17T03:14:02.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:02.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:14:02.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:02.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-17T03:14:02.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:02.993 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:14:03.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-17T03:14:03.128 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-17T03:14:03.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:14:03.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.132 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:14:03.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.172 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-09-17T03:14:03.277 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-09-17T03:14:03.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:14:03.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.280 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:14:03.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-09-17T03:14:03.415 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-09-17T03:14:03.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:14:03.418 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T03:14:03.419 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:14:03.419 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:03.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 -- 172.21.15.153:0/936107011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40b4990 msgr2=0x7f94a40b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 --2- 172.21.15.153:0/936107011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40b4990 0x7f94a40b4da0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f949c005fd0 tx=0x7f949c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 -- 172.21.15.153:0/936107011 shutdown_connections 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 --2- 172.21.15.153:0/936107011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40b4990 0x7f94a40b4da0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 --2- 172.21.15.153:0/936107011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a40cc8d0 0x7f94a40ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 -- 172.21.15.153:0/936107011 >> 172.21.15.153:0/936107011 conn(0x7f94a406f940 msgr2=0x7f94a40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 -- 172.21.15.153:0/936107011 shutdown_connections 2024-09-17T03:14:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.643+0000 7f94a3e00640 1 -- 172.21.15.153:0/936107011 wait complete. 2024-09-17T03:14:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.646+0000 7f94a3e00640 1 Processor -- start 2024-09-17T03:14:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.646+0000 7f94a3e00640 1 -- start start 2024-09-17T03:14:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 0x7f94a415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a415cb20 0x7f94a415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94a406d600 con 0x7f94a40b4990 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f94a406d480 con 0x7f94a40cc8d0 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f94a406d780 con 0x7f94a415cb20 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.647+0000 7f94a2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56634/0 (socket says 172.21.15.153:56634) 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a3400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a415cb20 0x7f94a415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 -- 172.21.15.153:0/2958648282 learned_addr learned my addr 172.21.15.153:0/2958648282 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f949a000640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 0x7f94a415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 -- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a415cb20 msgr2=0x7f94a415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a415cb20 0x7f94a415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 -- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 msgr2=0x7f94a415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 0x7f94a415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 -- 172.21.15.153:0/2958648282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a41f8f70 con 0x7f94a40b4990 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f949a000640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 0x7f94a415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.648+0000 7f94a2a00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f949400c3c0 tx=0x7f949400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.649+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494017070 con 0x7f94a40b4990 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.649+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94940035f0 con 0x7f94a40b4990 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.649+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494003a40 con 0x7f94a40b4990 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.649+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a41f9210 con 0x7f94a40b4990 2024-09-17T03:14:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.649+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a41f97d0 con 0x7f94a40b4990 2024-09-17T03:14:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.650+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a406dc30 con 0x7f94a40b4990 2024-09-17T03:14:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.651+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f949401a070 con 0x7f94a40b4990 2024-09-17T03:14:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.652+0000 7f949b400640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 0x7f948007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.652+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f949409a320 con 0x7f94a40b4990 2024-09-17T03:14:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.652+0000 7f949a000640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 0x7f948007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.653+0000 7f949a000640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 0x7f948007b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94a4156c40 tx=0x7f948c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.656+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f94a40cd220 con 0x7f94a40b4990 2024-09-17T03:14:03.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.877+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f94a40d0dd0 con 0x7f94a40b4990 2024-09-17T03:14:03.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.878+0000 7f949b400640 1 -- 172.21.15.153:0/2958648282 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f9494061d30 con 0x7f94a40b4990 2024-09-17T03:14:03.877 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:14:03.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 msgr2=0x7f948007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:03.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 0x7f948007b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94a4156c40 tx=0x7f948c005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 msgr2=0x7f94a41396c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f949400c3c0 tx=0x7f949400c880 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 shutdown_connections 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9480078bc0 0x7f948007b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94a415cb20 0x7f94a415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94a40cc8d0 0x7f94a415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 --2- 172.21.15.153:0/2958648282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94a40b4990 0x7f94a41396c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.880+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 >> 172.21.15.153:0/2958648282 conn(0x7f94a406f940 msgr2=0x7f94a40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.881+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 shutdown_connections 2024-09-17T03:14:03.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:03.881+0000 7f94a3e00640 1 -- 172.21.15.153:0/2958648282 wait complete. 2024-09-17T03:14:03.902 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:14:03.902 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:03.902 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-17T03:14:03.902 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:14:03.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:03.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:14:03.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:14:03.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:03.903 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:03.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:03.903 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:03.938 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42675sec preferred_lft 42675sec 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-17T03:14:03.939 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:03.940 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:14:03.940 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:14:03.941 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:04.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:04.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:04.163 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:04.218 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-17T03:14:04.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:04.221 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-17T03:14:04.257 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-17T03:14:04.257 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:04.257 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:04.257 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:04.258 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:04.258 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:04.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:04.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:04.456 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:14:04.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:04.491 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-17T03:14:04.566 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:04.566 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:04.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:14:04.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T03:14:04.566 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:04.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:04.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:04.743 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T03:14:04.744 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:04.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:05.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:05.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:05.126 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:05.161 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:05.162 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:05.162 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:05.236 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:05.237 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:05.431 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:05.431 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:05.432 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:06.048 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:06.049 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:06.049 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:06.049 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:06.049 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:14:06.085 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:06.086 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:06.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:06.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:06.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:06.147 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:06.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:06.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:06.238 INFO:teuthology.orchestra.run.smithi153.stdout:client4759 2024-09-17T03:14:06.238 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:06.238 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:06.274 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:06.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:06.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:06.404 INFO:teuthology.orchestra.run.smithi153.stdout:client4759 2024-09-17T03:14:06.404 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:06.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:06.493 INFO:teuthology.orchestra.run.smithi153.stdout:client4759 2024-09-17T03:14:06.496 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a48c3a5-c841-4727-8f9d-e71702e4a9bd.client4759/status') 2024-09-17T03:14:06.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:06.595 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4759 (3)172.21.15.153:0/915690585 2024-09-17T03:14:06.595 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-09-17T03:14:06.595 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-09-17T03:14:06.595 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-09-17T03:14:06.595 INFO:teuthology.orchestra.run.smithi153.stderr:70 bytes copied, 5.6475e-05 s, 1.2 MB/s 2024-09-17T03:14:06.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:06.606 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T03:14:06.606 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:14:06.606 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:14:06.606 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:06.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 -- 172.21.15.153:0/395508832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db4073dd0 msgr2=0x7f4d98003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 --2- 172.21.15.153:0/395508832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db4073dd0 0x7f4d98003a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009b50 tx=0x7f4d98005830 comp rx=0 tx=0).stop 2024-09-17T03:14:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db2800640 1 -- 172.21.15.153:0/395508832 reap_dead start 2024-09-17T03:14:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 -- 172.21.15.153:0/395508832 shutdown_connections 2024-09-17T03:14:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 -- 172.21.15.153:0/395508832 >> 172.21.15.153:0/395508832 conn(0x7f4db406f940 msgr2=0x7f4db40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 -- 172.21.15.153:0/395508832 shutdown_connections 2024-09-17T03:14:06.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.833+0000 7f4db3200640 1 -- 172.21.15.153:0/395508832 wait complete. 2024-09-17T03:14:06.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.836+0000 7f4db3200640 1 Processor -- start 2024-09-17T03:14:06.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.836+0000 7f4db3200640 1 -- start start 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db414b200 0x7f4db4140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db4140870 0x7f4db415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40cf220 con 0x7f4db4073dd0 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4db415c6d0 con 0x7f4db4140870 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.837+0000 7f4db3200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4db40cf3a0 con 0x7f4db414b200 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55050/0 (socket says 172.21.15.153:55050) 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 -- 172.21.15.153:0/4129891569 learned_addr learned my addr 172.21.15.153:0/4129891569 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1400640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db414b200 0x7f4db4140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db2800640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db4140870 0x7f4db415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 -- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db414b200 msgr2=0x7f4db4140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db414b200 0x7f4db4140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 -- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db4140870 msgr2=0x7f4db415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db4140870 0x7f4db415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 -- 172.21.15.153:0/4129891569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db414a440 con 0x7f4db4073dd0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.838+0000 7f4db1e00640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009a70 tx=0x7f4da4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.839+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4038040 con 0x7f4db4073dd0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.839+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4da4041070 con 0x7f4db4073dd0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.839+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db414a720 con 0x7f4db4073dd0 2024-09-17T03:14:06.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.839+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4033d30 con 0x7f4db4073dd0 2024-09-17T03:14:06.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.839+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db4140cf0 con 0x7f4db4073dd0 2024-09-17T03:14:06.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.840+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db4155c90 con 0x7f4db4073dd0 2024-09-17T03:14:06.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.841+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4da4046460 con 0x7f4db4073dd0 2024-09-17T03:14:06.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.842+0000 7f4daa000640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 0x7f4d9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.842+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4da40bb9a0 con 0x7f4db4073dd0 2024-09-17T03:14:06.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.843+0000 7f4db1400640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 0x7f4d9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.843+0000 7f4db1400640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 0x7f4d9407b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4db414ca20 tx=0x7f4da0006970 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:06.846+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4db4155c90 con 0x7f4db4073dd0 2024-09-17T03:14:07.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.067+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4db40d00c0 con 0x7f4db4073dd0 2024-09-17T03:14:07.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.067+0000 7f4daa000640 1 -- 172.21.15.153:0/4129891569 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f4da4083440 con 0x7f4db4073dd0 2024-09-17T03:14:07.067 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 msgr2=0x7f4d9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 0x7f4d9407b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4db414ca20 tx=0x7f4da0006970 comp rx=0 tx=0).stop 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 msgr2=0x7f4db413f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009a70 tx=0x7f4da4033670 comp rx=0 tx=0).stop 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 shutdown_connections 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d94078bc0 0x7f4d9407b0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db4140870 0x7f4db415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db414b200 0x7f4db4140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 --2- 172.21.15.153:0/4129891569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4db4073dd0 0x7f4db413f9e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 >> 172.21.15.153:0/4129891569 conn(0x7f4db406f940 msgr2=0x7f4db4072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 shutdown_connections 2024-09-17T03:14:07.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07.070+0000 7f4db3200640 1 -- 172.21.15.153:0/4129891569 wait complete. 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:07.095 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:14:07.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.096 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-17T03:14:07.132 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:07.132 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:07.132 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:07.132 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:07.133 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::48ca:57ff:fe1c:b853/64 scope link 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:14:07.134 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::30bd:f5ff:fe93:c568/64 scope link 2024-09-17T03:14:07.135 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.135 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:07.226 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-17T03:14:07.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.229 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-17T03:14:07.265 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-17T03:14:07.266 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:07.266 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:07.266 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:07.266 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:07.266 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:07.266 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:07.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:07.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:07.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:07.267 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:07.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:07.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:07.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.464 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:14:07.499 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:14:07.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.500 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-17T03:14:07.574 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T03:14:07.575 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:07.575 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:07.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:14:07.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T03:14:07.576 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:07.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:07.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:07.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c2:aa:ad:f4:e3:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c0aa:adff:fef4:e333/64 scope link 2024-09-17T03:14:07.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:07.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.869 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:07.870 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether c2:aa:ad:f4:e3:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:14:07.870 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:14:07.870 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.870 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::c0aa:adff:fef4:e333/64 scope link 2024-09-17T03:14:07.870 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:07.872 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T03:14:07.872 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:07.872 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:07.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T03:14:07.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:14:07.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T03:14:07.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T03:14:07.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T03:14:07.873 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:07.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:08.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:08.087 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:08.087 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:08.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2024-09-17T03:14:08.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:14:08.087 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:08.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:08.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:08.253 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T03:14:08.288 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:14:08.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:08.288 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:14:08.363 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:08.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:08.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:14:08.558 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:14:08.558 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:14:08.558 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:08.579 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:14:08.579 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:14:08.579 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:08.579 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:08.579 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:14:08.611 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:14:08.612 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T03:14:08.612 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:08.613 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:08.613 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:08.613 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:08.615 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:08.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:08.616 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:14:08.672 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:08.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:08.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:08.762 INFO:teuthology.orchestra.run.smithi153.stdout:client4803 2024-09-17T03:14:08.762 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:08.762 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:08.798 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:08.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:08.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:08.927 INFO:teuthology.orchestra.run.smithi153.stdout:client4803 2024-09-17T03:14:08.927 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:09.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:09.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:09.016 INFO:teuthology.orchestra.run.smithi153.stdout:client4803 2024-09-17T03:14:09.016 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a48c3a5-c841-4727-8f9d-e71702e4a9bd.client4803/status') 2024-09-17T03:14:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:09.115 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.4803 (3)192.168.0.2:0/2414792972 2024-09-17T03:14:09.116 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-09-17T03:14:09.116 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-09-17T03:14:09.116 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-09-17T03:14:09.116 INFO:teuthology.orchestra.run.smithi153.stderr:69 bytes copied, 8.3793e-05 s, 823 kB/s 2024-09-17T03:14:09.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:09.126 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T03:14:09.126 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:14:09.126 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:14:09.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:09.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 -- 172.21.15.153:0/1144402888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 msgr2=0x7f68d815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 --2- 172.21.15.153:0/1144402888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d815f5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68d8072d40 tx=0x7f68d002aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 -- 172.21.15.153:0/1144402888 shutdown_connections 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 --2- 172.21.15.153:0/1144402888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d815f5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 --2- 172.21.15.153:0/1144402888 >> v2:172.21.15.164:3300/0 conn(0x7f68d80cf930 0x7f68d80ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 -- 172.21.15.153:0/1144402888 >> 172.21.15.153:0/1144402888 conn(0x7f68d80cca40 msgr2=0x7f68d80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 -- 172.21.15.153:0/1144402888 shutdown_connections 2024-09-17T03:14:09.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.349+0000 7f68e0400640 1 -- 172.21.15.153:0/1144402888 wait complete. 2024-09-17T03:14:09.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.351+0000 7f68e0400640 1 Processor -- start 2024-09-17T03:14:09.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.352+0000 7f68e0400640 1 -- start start 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f68d80cf930 0x7f68d80a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 0x7f68d8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68d806ddf0 con 0x7f68d80ce860 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f68d815fe60 con 0x7f68d815b9f0 2024-09-17T03:14:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68e0400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f68d806df70 con 0x7f68d80cf930 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68dda00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68dda00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55058/0 (socket says 172.21.15.153:55058) 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68dda00640 1 -- 172.21.15.153:0/183174647 learned_addr learned my addr 172.21.15.153:0/183174647 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.353+0000 7f68de400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 0x7f68d8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dd000640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f68d80cf930 0x7f68d80a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 -- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f68d80cf930 msgr2=0x7f68d80a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f68d80cf930 0x7f68d80a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 -- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 msgr2=0x7f68d8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 0x7f68d8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 -- 172.21.15.153:0/183174647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d80b2eb0 con 0x7f68d80ce860 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68de400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 0x7f68d8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68dda00640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00b420 tx=0x7f68cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc011830 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68cc016070 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d80a0f90 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc011d60 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.354+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d80a1270 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.355+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d806e460 con 0x7f68d80ce860 2024-09-17T03:14:09.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.357+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68cc01b460 con 0x7f68d80ce860 2024-09-17T03:14:09.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.358+0000 7f68d5600640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 0x7f68b807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.358+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f68cc09aca0 con 0x7f68d80ce860 2024-09-17T03:14:09.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.358+0000 7f68dd000640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 0x7f68b807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.359+0000 7f68dd000640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 0x7f68b807b100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005fd0 tx=0x7f68c4005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:09.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.362+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f68cc020020 con 0x7f68d80ce860 2024-09-17T03:14:09.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.581+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f68d80ce640 con 0x7f68d80ce860 2024-09-17T03:14:09.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.581+0000 7f68d5600640 1 -- 172.21.15.153:0/183174647 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f68cc062d00 con 0x7f68d80ce860 2024-09-17T03:14:09.581 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 msgr2=0x7f68b807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 0x7f68b807b100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005fd0 tx=0x7f68c4005850 comp rx=0 tx=0).stop 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 msgr2=0x7f68d80b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00b420 tx=0x7f68cc00b8e0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 shutdown_connections 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f68b8078bf0 0x7f68b807b100 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d815b9f0 0x7f68d8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f68d80cf930 0x7f68d80a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 --2- 172.21.15.153:0/183174647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d80ce860 0x7f68d80b5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 >> 172.21.15.153:0/183174647 conn(0x7f68d80cca40 msgr2=0x7f68d8159560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:09.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 shutdown_connections 2024-09-17T03:14:09.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:09.584+0000 7f68e0400640 1 -- 172.21.15.153:0/183174647 wait complete. 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:09.609 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:14:09.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:09.610 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-09-17T03:14:09.649 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:09.649 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:09.649 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:09.650 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:09.651 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:09.651 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:09.651 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-09-17T03:14:09.651 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link noprefixroute 2024-09-17T03:14:09.651 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:09.652 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-09-17T03:14:09.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:14:09.653 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:09.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:10.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:10.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:10.073 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:10.128 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-17T03:14:10.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:10.132 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-09-17T03:14:10.182 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-09-17T03:14:10.183 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:10.183 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:10.183 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:10.183 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:10.183 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:10.183 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:10.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:10.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:10.184 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:10.184 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:10.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:10.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:10.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:10.779 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:14:10.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:10.814 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-09-17T03:14:10.890 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:10.890 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:10.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:14:10.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T03:14:10.890 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:11.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:11.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:11.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T03:14:11.067 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:11.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:11.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:11.312 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:11.312 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:11.312 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-09-17T03:14:11.312 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:14:11.312 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:11.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:11.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:11.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:11.485 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:14:11.520 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:14:11.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:11.520 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:14:11.595 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:11.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:11.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:14:11.806 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:14:11.806 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:14:11.806 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:12.441 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:14:12.441 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:14:12.441 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:12.441 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:12.441 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:12.475 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:14:12.475 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:14:12.476 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:14:12.477 INFO:teuthology.orchestra.run.smithi164.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:14:12.477 INFO:teuthology.orchestra.run.smithi164.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:12.477 INFO:teuthology.orchestra.run.smithi164.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:12.477 INFO:teuthology.orchestra.run.smithi164.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:12.478 INFO:teuthology.orchestra.run.smithi164.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:12.480 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:12.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:12.480 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:14:12.537 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:12.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:12.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:12.627 INFO:teuthology.orchestra.run.smithi164.stdout:client4812 2024-09-17T03:14:12.627 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:12.627 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:12.663 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:12.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:12.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:12.792 INFO:teuthology.orchestra.run.smithi164.stdout:client4812 2024-09-17T03:14:12.792 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:12.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:12.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:12.882 INFO:teuthology.orchestra.run.smithi164.stdout:client4812 2024-09-17T03:14:12.882 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a48c3a5-c841-4727-8f9d-e71702e4a9bd.client4812/status') 2024-09-17T03:14:12.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:12.980 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4812 (3)172.21.15.164:0/2439162531 2024-09-17T03:14:12.981 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2024-09-17T03:14:12.981 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2024-09-17T03:14:12.981 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2024-09-17T03:14:12.981 INFO:teuthology.orchestra.run.smithi164.stderr:71 bytes copied, 6.5286e-05 s, 1.1 MB/s 2024-09-17T03:14:12.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:12.992 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T03:14:12.992 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:14:12.992 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:14:12.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 -- 172.21.15.153:0/2653023731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba880cbc10 msgr2=0x7fba880cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 --2- 172.21.15.153:0/2653023731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba880cbc10 0x7fba880cc020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba88076360 tx=0x7fba7402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 -- 172.21.15.153:0/2653023731 shutdown_connections 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 --2- 172.21.15.153:0/2653023731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba880cbc10 0x7fba880cc020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 --2- 172.21.15.153:0/2653023731 >> v2:172.21.15.164:3300/0 conn(0x7fba88074cb0 0x7fba88073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 -- 172.21.15.153:0/2653023731 >> 172.21.15.153:0/2653023731 conn(0x7fba880cca40 msgr2=0x7fba880cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:13.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 -- 172.21.15.153:0/2653023731 shutdown_connections 2024-09-17T03:14:13.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.227+0000 7fba8d400640 1 -- 172.21.15.153:0/2653023731 wait complete. 2024-09-17T03:14:13.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.229+0000 7fba8d400640 1 Processor -- start 2024-09-17T03:14:13.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.229+0000 7fba8d400640 1 -- start start 2024-09-17T03:14:13.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 0x7fba881f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba880cbc10 0x7fba880b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba8806f360 con 0x7fba88074cb0 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fba8806f1e0 con 0x7fba8806ddf0 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba8d400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fba8806f4e0 con 0x7fba880cbc10 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba85e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba85e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55078/0 (socket says 172.21.15.153:55078) 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba86800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 0x7fba881f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba85e00640 1 -- 172.21.15.153:0/1689013498 learned_addr learned my addr 172.21.15.153:0/1689013498 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.231+0000 7fba87200640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba880cbc10 0x7fba880b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 -- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba880cbc10 msgr2=0x7fba880b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba880cbc10 0x7fba880b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 -- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 msgr2=0x7fba881f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 0x7fba881f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 -- 172.21.15.153:0/1689013498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8806e430 con 0x7fba88074cb0 2024-09-17T03:14:13.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba86800640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 0x7fba881f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:13.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba85e00640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba74034040 tx=0x7fba74003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7403e030 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba74003e00 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74035040 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba88154f20 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.232+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba881554e0 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.233+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8806f990 con 0x7fba88074cb0 2024-09-17T03:14:13.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.235+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba74041030 con 0x7fba88074cb0 2024-09-17T03:14:13.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.236+0000 7fba7ea00640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 0x7fba6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.236+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fba740bb970 con 0x7fba88074cb0 2024-09-17T03:14:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.236+0000 7fba86800640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 0x7fba6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.237+0000 7fba86800640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 0x7fba6807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba8815a730 tx=0x7fba7800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.240+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba74083310 con 0x7fba88074cb0 2024-09-17T03:14:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.459+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fba8815bb20 con 0x7fba88074cb0 2024-09-17T03:14:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.460+0000 7fba7ea00640 1 -- 172.21.15.153:0/1689013498 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fba74087d40 con 0x7fba88074cb0 2024-09-17T03:14:13.459 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:14:13.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 msgr2=0x7fba6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 0x7fba6807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba8815a730 tx=0x7fba7800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 msgr2=0x7fba880b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba74034040 tx=0x7fba74003910 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 shutdown_connections 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fba68078b90 0x7fba6807b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba880cbc10 0x7fba880b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba88074cb0 0x7fba880b0d20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 --2- 172.21.15.153:0/1689013498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba8806ddf0 0x7fba881f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 >> 172.21.15.153:0/1689013498 conn(0x7fba880cca40 msgr2=0x7fba881e4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 shutdown_connections 2024-09-17T03:14:13.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:13.462+0000 7fba8d400640 1 -- 172.21.15.153:0/1689013498 wait complete. 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:13.486 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:14:13.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:13.487 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-09-17T03:14:13.522 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-09-17T03:14:13.523 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link noprefixroute 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 06:f6:05:11:68:20 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::f017:72ff:fe76:9c09/64 scope link 2024-09-17T03:14:13.524 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.525 INFO:teuthology.orchestra.run.smithi164.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:13.525 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 06:f6:05:11:68:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:14:13.525 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::4f6:5ff:fe11:6820/64 scope link 2024-09-17T03:14:13.525 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:13.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:13.525 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:13.616 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-17T03:14:13.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:13.619 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-09-17T03:14:13.655 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-09-17T03:14:13.655 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:13.655 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:13.655 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:13.655 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:13.656 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:13.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:13.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:13.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:13.851 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:14:13.887 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:14:13.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:13.888 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-09-17T03:14:13.962 INFO:teuthology.orchestra.run.smithi164.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T03:14:13.962 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:13.963 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:13.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:14:13.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T03:14:13.963 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:14.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:14.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:14.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:14.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:14:14.195 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:14.195 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 52:1b:98:af:0e:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::501b:98ff:feaf:e67/64 scope link 2024-09-17T03:14:14.196 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:14.198 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:14:14.253 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:14.253 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:14.253 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 52:1b:98:af:0e:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::501b:98ff:feaf:e67/64 scope link 2024-09-17T03:14:14.254 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:14.256 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T03:14:14.256 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T03:14:14.257 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:14.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:14.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:14.474 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:14.474 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-09-17T03:14:14.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.1 up 2024-09-17T03:14:14.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:14:14.474 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-09-17T03:14:14.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:14.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:14.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:14.640 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T03:14:14.675 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:14:14.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:14.676 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:14:14.750 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:14.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:14.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:14:14.945 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:14:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:14:14.946 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:invalid new device string format 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:14:14.996 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:14:14.997 INFO:teuthology.orchestra.run.smithi164.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T03:14:14.997 INFO:teuthology.orchestra.run.smithi164.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:14.997 INFO:teuthology.orchestra.run.smithi164.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:14.997 INFO:teuthology.orchestra.run.smithi164.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:14.998 INFO:teuthology.orchestra.run.smithi164.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:15.000 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:15.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:15.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:14:15.056 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:15.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:15.145 INFO:teuthology.orchestra.run.smithi164.stdout:client4824 2024-09-17T03:14:15.146 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:15.146 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:15.181 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:15.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:15.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:15.309 INFO:teuthology.orchestra.run.smithi164.stdout:client4824 2024-09-17T03:14:15.310 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:15.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:15.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:15.398 INFO:teuthology.orchestra.run.smithi164.stdout:client4824 2024-09-17T03:14:15.398 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a48c3a5-c841-4727-8f9d-e71702e4a9bd.client4824/status') 2024-09-17T03:14:15.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:15.497 INFO:teuthology.orchestra.run.smithi164.stdout:instance: client.4824 (3)172.21.15.164:0/4221355038 2024-09-17T03:14:15.498 INFO:teuthology.orchestra.run.smithi164.stdout:blocklisted: false 2024-09-17T03:14:15.498 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records in 2024-09-17T03:14:15.498 INFO:teuthology.orchestra.run.smithi164.stderr:0+1 records out 2024-09-17T03:14:15.498 INFO:teuthology.orchestra.run.smithi164.stderr:71 bytes copied, 6.4658e-05 s, 1.1 MB/s 2024-09-17T03:14:15.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-17T03:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:15.508 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T03:14:15.548 INFO:tasks.cephfs_test_runner:Starting test: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) The maximum number of openfiles omap objects keys are now equal to 2024-09-17T03:14:15.548 INFO:tasks.cephfs_test_runner:test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-09-17T03:14:15.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 -- 172.21.15.153:0/849752449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f918415b9f0 msgr2=0x7f91840cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 --2- 172.21.15.153:0/849752449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f918415b9f0 0x7f91840cf930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9184159530 tx=0x7f917402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 -- 172.21.15.153:0/849752449 shutdown_connections 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 --2- 172.21.15.153:0/849752449 >> v2:172.21.15.164:3300/0 conn(0x7f91840ce860 0x7f918415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 --2- 172.21.15.153:0/849752449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 0x7f91840ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 --2- 172.21.15.153:0/849752449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f918415b9f0 0x7f91840cf930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 -- 172.21.15.153:0/849752449 >> 172.21.15.153:0/849752449 conn(0x7f91840cca40 msgr2=0x7f91840cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 -- 172.21.15.153:0/849752449 shutdown_connections 2024-09-17T03:14:15.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.783+0000 7f9189600640 1 -- 172.21.15.153:0/849752449 wait complete. 2024-09-17T03:14:15.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.786+0000 7f9189600640 1 Processor -- start 2024-09-17T03:14:15.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.786+0000 7f9189600640 1 -- start start 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 0x7f91841540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 0x7f91841545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f918415fe70 con 0x7f91840ce860 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f918415fcf0 con 0x7f918415b9f0 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9189600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f918406ddf0 con 0x7f91840cefa0 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.787+0000 7f9182a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32818/0 (socket says 172.21.15.153:32818) 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 -- 172.21.15.153:0/2699511970 learned_addr learned my addr 172.21.15.153:0/2699511970 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:15.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182000640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 0x7f91841540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9183400640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 0x7f91841545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 -- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 msgr2=0x7f91841540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 0x7f91841540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 -- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 msgr2=0x7f91841545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 0x7f91841545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 -- 172.21.15.153:0/2699511970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91840b4b50 con 0x7f91840ce860 2024-09-17T03:14:15.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9183400640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 0x7f91841545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.788+0000 7f9182a00640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9174034040 tx=0x7f9174003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.789+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917403e030 con 0x7f91840ce860 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.789+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9174003e00 con 0x7f91840ce860 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.789+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174035040 con 0x7f91840ce860 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.789+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91840b4e30 con 0x7f91840ce860 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.789+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91840b53f0 con 0x7f91840ce860 2024-09-17T03:14:15.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.790+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918415f5b0 con 0x7f91840ce860 2024-09-17T03:14:15.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.791+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9174041030 con 0x7f91840ce860 2024-09-17T03:14:15.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.792+0000 7f917aa00640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 0x7f916407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.792+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f91740bb890 con 0x7f91840ce860 2024-09-17T03:14:15.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.793+0000 7f9182000640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 0x7f916407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.793+0000 7f9182000640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 0x7f916407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9184073420 tx=0x7f917000b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.797+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91740832c0 con 0x7f91840ce860 2024-09-17T03:14:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.981+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f918406e1f0 con 0x7f91840ce860 2024-09-17T03:14:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.982+0000 7f917aa00640 1 -- 172.21.15.153:0/2699511970 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18826 (secure 0 0 0) 0x7f9174087cf0 con 0x7f91840ce860 2024-09-17T03:14:15.982 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:15.982 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":29,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:12.317547+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 msgr2=0x7f916407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 0x7f916407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9184073420 tx=0x7f917000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 msgr2=0x7f91841556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9174034040 tx=0x7f9174003910 comp rx=0 tx=0).stop 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 shutdown_connections 2024-09-17T03:14:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9164078b90 0x7f916407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f918415b9f0 0x7f91841545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91840cefa0 0x7f91841540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 --2- 172.21.15.153:0/2699511970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91840ce860 0x7f91841556e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 >> 172.21.15.153:0/2699511970 conn(0x7f91840cca40 msgr2=0x7f91840c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 shutdown_connections 2024-09-17T03:14:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:15.985+0000 7f9189600640 1 -- 172.21.15.153:0/2699511970 wait complete. 2024-09-17T03:14:16.006 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:13:22.848530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T03:13:31.742543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T03:13:32.565658+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T03:13:36.143662+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-17T03:14:16.006 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:14:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 -- 172.21.15.153:0/3919246929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec073dd0 msgr2=0x7f22ec06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 --2- 172.21.15.153:0/3919246929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec073dd0 0x7f22ec06ddf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009830 tx=0x7f22d802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 -- 172.21.15.153:0/3919246929 shutdown_connections 2024-09-17T03:14:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 --2- 172.21.15.153:0/3919246929 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec073dd0 0x7f22ec06ddf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 -- 172.21.15.153:0/3919246929 >> 172.21.15.153:0/3919246929 conn(0x7f22ec0cca40 msgr2=0x7f22ec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 -- 172.21.15.153:0/3919246929 shutdown_connections 2024-09-17T03:14:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.233+0000 7f22f1a00640 1 -- 172.21.15.153:0/3919246929 wait complete. 2024-09-17T03:14:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.235+0000 7f22f1a00640 1 Processor -- start 2024-09-17T03:14:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.235+0000 7f22f1a00640 1 -- start start 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec073dd0 0x7f22ec1f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 0x7f22ec157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec06f670 con 0x7f22ec06e330 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec06f4f0 con 0x7f22ec074cb0 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22f1a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f22ec06f7f0 con 0x7f22ec073dd0 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32834/0 (socket says 172.21.15.153:32834) 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 -- 172.21.15.153:0/513288359 learned_addr learned my addr 172.21.15.153:0/513288359 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eb400640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 0x7f22ec157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22ea000640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec073dd0 0x7f22ec1f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 -- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec073dd0 msgr2=0x7f22ec1f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec073dd0 0x7f22ec1f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 -- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 msgr2=0x7f22ec157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 0x7f22ec157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eaa00640 1 -- 172.21.15.153:0/513288359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec1f9270 con 0x7f22ec06e330 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.237+0000 7f22eb400640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 0x7f22ec157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22eaa00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c3c0 tx=0x7f22dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc017070 con 0x7f22ec06e330 2024-09-17T03:14:16.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec1f9550 con 0x7f22ec06e330 2024-09-17T03:14:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22dc0053e0 con 0x7f22ec06e330 2024-09-17T03:14:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc003850 con 0x7f22ec06e330 2024-09-17T03:14:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.238+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec1f53a0 con 0x7f22ec06e330 2024-09-17T03:14:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.239+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ec1f9a70 con 0x7f22ec06e330 2024-09-17T03:14:16.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.240+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22dc01a070 con 0x7f22ec06e330 2024-09-17T03:14:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.241+0000 7f22e2a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.241+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f22dc09a540 con 0x7f22ec06e330 2024-09-17T03:14:16.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.242+0000 7f22ea000640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.242+0000 7f22ea000640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22d8034000 tx=0x7f22d8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:16.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.246+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22ec06e740 con 0x7f22ec06e330 2024-09-17T03:14:16.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.428+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22ec0cdb70 con 0x7f22ec06e330 2024-09-17T03:14:16.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.429+0000 7f22e2a00640 1 -- 172.21.15.153:0/513288359 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f22dc062540 con 0x7f22ec06e330 2024-09-17T03:14:16.428 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-09-17T03:14:16.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 msgr2=0x7f22cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22d8034000 tx=0x7f22d8004730 comp rx=0 tx=0).stop 2024-09-17T03:14:16.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 msgr2=0x7f22ec0a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c3c0 tx=0x7f22dc00c880 comp rx=0 tx=0).stop 2024-09-17T03:14:16.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 shutdown_connections 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f22cc078b90 0x7f22cc07b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22ec074cb0 0x7f22ec157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22ec073dd0 0x7f22ec1f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 --2- 172.21.15.153:0/513288359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec06e330 0x7f22ec0a0e20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 >> 172.21.15.153:0/513288359 conn(0x7f22ec0cca40 msgr2=0x7f22ec15f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 shutdown_connections 2024-09-17T03:14:16.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.431+0000 7f22f1a00640 1 -- 172.21.15.153:0/513288359 wait complete. 2024-09-17T03:14:16.451 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T03:14:16.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 -- 172.21.15.153:0/4231903246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc0d0b00 msgr2=0x7ff7bc145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/4231903246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc145040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac005fd0 tx=0x7ff7ac02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 -- 172.21.15.153:0/4231903246 shutdown_connections 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/4231903246 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc160990 0x7ff7bc071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/4231903246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc145040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 -- 172.21.15.153:0/4231903246 >> 172.21.15.153:0/4231903246 conn(0x7ff7bc0d1020 msgr2=0x7ff7bc0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 -- 172.21.15.153:0/4231903246 shutdown_connections 2024-09-17T03:14:16.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.676+0000 7ff7c1c00640 1 -- 172.21.15.153:0/4231903246 wait complete. 2024-09-17T03:14:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.678+0000 7ff7c1c00640 1 Processor -- start 2024-09-17T03:14:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.679+0000 7ff7c1c00640 1 -- start start 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc0cdf50 con 0x7ff7bc160990 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc072240 con 0x7ff7bc0d0b00 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff7bc0ce0d0 con 0x7ff7bc0716a0 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7bbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7bbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:48674/0 (socket says 172.21.15.153:48674) 2024-09-17T03:14:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7c1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32854/0 (socket says 172.21.15.153:32854) 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.680+0000 7ff7bbe00640 1 -- 172.21.15.153:0/768707085 learned_addr learned my addr 172.21.15.153:0/768707085 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 -- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7bc0d0b00 msgr2=0x7ff7bc1f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc1f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 -- 172.21.15.153:0/768707085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 msgr2=0x7ff7bc141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 -- 172.21.15.153:0/768707085 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7bc143960 con 0x7ff7bc0716a0 2024-09-17T03:14:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7c1200640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7bbe00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac034040 tx=0x7ff7ac0035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.681+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac03e030 con 0x7ff7bc0716a0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.682+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7ac003ae0 con 0x7ff7bc0716a0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.682+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac035040 con 0x7ff7bc0716a0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.682+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7bc143c40 con 0x7ff7bc0716a0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.682+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7bc144200 con 0x7ff7bc0716a0 2024-09-17T03:14:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.683+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7bc06ab30 con 0x7ff7bc0716a0 2024-09-17T03:14:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.684+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7ac041030 con 0x7ff7bc0716a0 2024-09-17T03:14:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.685+0000 7ff7b3e00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 0x7ff79c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.685+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7ff7ac0bb780 con 0x7ff7bc0716a0 2024-09-17T03:14:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.685+0000 7ff7bb400640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 0x7ff79c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.686+0000 7ff7bb400640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 0x7ff79c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15c450 tx=0x7ff7a8005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.689+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7ac083230 con 0x7ff7bc0716a0 2024-09-17T03:14:16.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.873+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7bc0ce590 con 0x7ff7bc0716a0 2024-09-17T03:14:16.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.874+0000 7ff7b3e00640 1 -- 172.21.15.153:0/768707085 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ff7ac087c60 con 0x7ff7bc0716a0 2024-09-17T03:14:16.873 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-09-17T03:14:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 msgr2=0x7ff79c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 0x7ff79c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15c450 tx=0x7ff7a8005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 msgr2=0x7ff7bc154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac034040 tx=0x7ff7ac0035f0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 shutdown_connections 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff79c078b90 0x7ff79c07b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7bc160990 0x7ff7bc141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7bc0d0b00 0x7ff7bc1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 --2- 172.21.15.153:0/768707085 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7bc0716a0 0x7ff7bc154ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.876+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 >> 172.21.15.153:0/768707085 conn(0x7ff7bc0d1020 msgr2=0x7ff7bc073ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.877+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 shutdown_connections 2024-09-17T03:14:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:16.877+0000 7ff7c1c00640 1 -- 172.21.15.153:0/768707085 wait complete. 2024-09-17T03:14:16.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.126+0000 7fccf5800640 1 -- 172.21.15.153:0/1228212807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0152450 msgr2=0x7fccf006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.126+0000 7fccf5800640 1 --2- 172.21.15.153:0/1228212807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0152450 0x7fccf006e720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009860 tx=0x7fccd802a510 comp rx=0 tx=0).stop 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.127+0000 7fccf5800640 1 -- 172.21.15.153:0/1228212807 shutdown_connections 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.127+0000 7fccf5800640 1 --2- 172.21.15.153:0/1228212807 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0152450 0x7fccf006e720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.127+0000 7fccf5800640 1 -- 172.21.15.153:0/1228212807 >> 172.21.15.153:0/1228212807 conn(0x7fccf00d1020 msgr2=0x7fccf00d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.127+0000 7fccf5800640 1 -- 172.21.15.153:0/1228212807 shutdown_connections 2024-09-17T03:14:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.127+0000 7fccf5800640 1 -- 172.21.15.153:0/1228212807 wait complete. 2024-09-17T03:14:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.129+0000 7fccf5800640 1 Processor -- start 2024-09-17T03:14:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.129+0000 7fccf5800640 1 -- start start 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0072320 0x7fccf01e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccf0152450 0x7fccf01e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00b42e0 con 0x7fccf0071160 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00b4160 con 0x7fccf0152450 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.130+0000 7fccf5800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fccf00b4460 con 0x7fccf0072320 2024-09-17T03:14:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32868/0 (socket says 172.21.15.153:32868) 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 -- 172.21.15.153:0/480326019 learned_addr learned my addr 172.21.15.153:0/480326019 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fcce7400640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0072320 0x7fccf01e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccf4e00640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccf0152450 0x7fccf01e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 -- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0072320 msgr2=0x7fccf01e9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0072320 0x7fccf01e9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 -- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccf0152450 msgr2=0x7fccf01e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccf0152450 0x7fccf01e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 -- 172.21.15.153:0/480326019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf01f96a0 con 0x7fccf0071160 2024-09-17T03:14:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.131+0000 7fccefe00640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c430 tx=0x7fcce000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.132+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0017070 con 0x7fccf0071160 2024-09-17T03:14:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.132+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcce00053e0 con 0x7fccf0071160 2024-09-17T03:14:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.132+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0003850 con 0x7fccf0071160 2024-09-17T03:14:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.132+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf01f8b20 con 0x7fccf0071160 2024-09-17T03:14:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.132+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf01f90e0 con 0x7fccf0071160 2024-09-17T03:14:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.133+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf006e720 con 0x7fccf0071160 2024-09-17T03:14:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.134+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcce001a070 con 0x7fccf0071160 2024-09-17T03:14:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.135+0000 7fccecc00640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 0x7fcccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.135+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fcce009a3a0 con 0x7fccf0071160 2024-09-17T03:14:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.136+0000 7fcce7400640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 0x7fcccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.136+0000 7fcce7400640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 0x7fcccc07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fccd8034000 tx=0x7fccd8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.139+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcce0061e60 con 0x7fccf0071160 2024-09-17T03:14:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.323+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fccf00d15b0 con 0x7fccf0071160 2024-09-17T03:14:17.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.324+0000 7fccecc00640 1 -- 172.21.15.153:0/480326019 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fcce0066890 con 0x7fccf0071160 2024-09-17T03:14:17.323 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 msgr2=0x7fcccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 0x7fcccc07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fccd8034000 tx=0x7fccd8004730 comp rx=0 tx=0).stop 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 msgr2=0x7fccf014c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c430 tx=0x7fcce000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 shutdown_connections 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.326+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcccc078b90 0x7fcccc07b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fccf0152450 0x7fccf01e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fccf0072320 0x7fccf01e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 --2- 172.21.15.153:0/480326019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccf0071160 0x7fccf014c6b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 >> 172.21.15.153:0/480326019 conn(0x7fccf00d1020 msgr2=0x7fccf006d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 shutdown_connections 2024-09-17T03:14:17.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.327+0000 7fccf5800640 1 -- 172.21.15.153:0/480326019 wait complete. 2024-09-17T03:14:17.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 -- 172.21.15.153:0/2974663207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cf850 msgr2=0x7fb5541556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 --2- 172.21.15.153:0/2974663207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cf850 0x7fb5541556f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5540726b0 tx=0x7fb54802a540 comp rx=0 tx=0).stop 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 -- 172.21.15.153:0/2974663207 shutdown_connections 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 --2- 172.21.15.153:0/2974663207 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5540cc8d0 0x7fb5540ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 --2- 172.21.15.153:0/2974663207 >> v2:172.21.15.164:3300/0 conn(0x7fb55415f670 0x7fb554162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 --2- 172.21.15.153:0/2974663207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cf850 0x7fb5541556f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 -- 172.21.15.153:0/2974663207 >> 172.21.15.153:0/2974663207 conn(0x7fb55406f920 msgr2=0x7fb5540b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 -- 172.21.15.153:0/2974663207 shutdown_connections 2024-09-17T03:14:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.579+0000 7fb55a800640 1 -- 172.21.15.153:0/2974663207 wait complete. 2024-09-17T03:14:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.582+0000 7fb55a800640 1 Processor -- start 2024-09-17T03:14:17.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.582+0000 7fb55a800640 1 -- start start 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 0x7fb554153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb55415f670 0x7fb554157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb55406dfd0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb55406de50 con 0x7fb5540cf850 2024-09-17T03:14:17.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.583+0000 7fb55a800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb55406e150 con 0x7fb55415f670 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32890/0 (socket says 172.21.15.153:32890) 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 -- 172.21.15.153:0/3645012688 learned_addr learned my addr 172.21.15.153:0/3645012688 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559e00640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb55415f670 0x7fb554157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb558a00640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 0x7fb554153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 -- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb55415f670 msgr2=0x7fb554157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb55415f670 0x7fb554157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 -- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 msgr2=0x7fb554153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 0x7fb554153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 -- 172.21.15.153:0/3645012688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5541f6670 con 0x7fb5540cc8d0 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb558a00640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 0x7fb554153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:17.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.584+0000 7fb559400640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb548034040 tx=0x7fb5480039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.585+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54803e030 con 0x7fb5540cc8d0 2024-09-17T03:14:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.585+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5480047a0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.585+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5541f5dd0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.585+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548035040 con 0x7fb5540cc8d0 2024-09-17T03:14:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.585+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5541f6390 con 0x7fb5540cc8d0 2024-09-17T03:14:17.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.586+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5541556f0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.587+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb548041030 con 0x7fb5540cc8d0 2024-09-17T03:14:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.588+0000 7fb551600640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 0x7fb53407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.588+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fb5480bb8a0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.589+0000 7fb558a00640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 0x7fb53407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.589+0000 7fb558a00640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 0x7fb53407b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb540005fd0 tx=0x7fb540005d10 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.593+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5540cd220 con 0x7fb5540cc8d0 2024-09-17T03:14:17.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.778+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb55415d330 con 0x7fb5540cc8d0 2024-09-17T03:14:17.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.778+0000 7fb551600640 1 -- 172.21.15.153:0/3645012688 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fb5480839c0 con 0x7fb5540cc8d0 2024-09-17T03:14:17.777 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 32 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.780+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 msgr2=0x7fb53407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.780+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 0x7fb53407b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb540005fd0 tx=0x7fb540005d10 comp rx=0 tx=0).stop 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.780+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 msgr2=0x7fb5540b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.780+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb548034040 tx=0x7fb5480039e0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 shutdown_connections 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb534078b90 0x7fb53407b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb55415f670 0x7fb554157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5540cf850 0x7fb554153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 --2- 172.21.15.153:0/3645012688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5540cc8d0 0x7fb5540b1bc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 >> 172.21.15.153:0/3645012688 conn(0x7fb55406f920 msgr2=0x7fb5540b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 shutdown_connections 2024-09-17T03:14:17.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:17.781+0000 7fb55a800640 1 -- 172.21.15.153:0/3645012688 wait complete. 2024-09-17T03:14:17.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 -- 172.21.15.153:0/2773797141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 msgr2=0x7f58f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 --2- 172.21.15.153:0/2773797141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f58f800b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5908001d90 tx=0x7f58f8005830 comp rx=0 tx=0).stop 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 -- 172.21.15.153:0/2773797141 shutdown_connections 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 --2- 172.21.15.153:0/2773797141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f58f800b9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 -- 172.21.15.153:0/2773797141 >> 172.21.15.153:0/2773797141 conn(0x7f59100cca40 msgr2=0x7f59100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.025+0000 7f5917c00640 1 -- 172.21.15.153:0/2773797141 shutdown_connections 2024-09-17T03:14:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.026+0000 7f5917c00640 1 -- 172.21.15.153:0/2773797141 wait complete. 2024-09-17T03:14:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.028+0000 7f5917c00640 1 Processor -- start 2024-09-17T03:14:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.028+0000 7f5917c00640 1 -- start start 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5910153e40 0x7f5910154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59101e5db0 0x7f59101e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f591006e180 con 0x7f58f8005300 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f591006e000 con 0x7f59101e5db0 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.029+0000 7f5917c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f59100cbc10 con 0x7f5910153e40 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32902/0 (socket says 172.21.15.153:32902) 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 -- 172.21.15.153:0/1826418740 learned_addr learned my addr 172.21.15.153:0/1826418740 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f590fe00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5910153e40 0x7f5910154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59101e5db0 0x7f59101e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 -- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5910153e40 msgr2=0x7f5910154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5910153e40 0x7f5910154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 -- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59101e5db0 msgr2=0x7f59101e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59101e5db0 0x7f59101e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 -- 172.21.15.153:0/1826418740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591009e2e0 con 0x7f58f8005300 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f5915200640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59040066b0 tx=0x7f59040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.030+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904015070 con 0x7f58f8005300 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.031+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5904011920 con 0x7f58f8005300 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.031+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59101e6700 con 0x7f58f8005300 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.031+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904011d70 con 0x7f58f8005300 2024-09-17T03:14:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.031+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591009e860 con 0x7f58f8005300 2024-09-17T03:14:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.032+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59100cc170 con 0x7f58f8005300 2024-09-17T03:14:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.033+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5904018070 con 0x7f58f8005300 2024-09-17T03:14:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.034+0000 7f590cc00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 0x7f58f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.034+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f590409bf00 con 0x7f58f8005300 2024-09-17T03:14:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.034+0000 7f590fe00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 0x7f58f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.035+0000 7f590fe00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 0x7f58f007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59101e6a40 tx=0x7f58fc00f4d0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.038+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5904063f00 con 0x7f58f8005300 2024-09-17T03:14:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.295+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) -- 0x7f591015e560 con 0x7f58f8005300 2024-09-17T03:14:18.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.347+0000 7f590cc00640 1 -- 172.21.15.153:0/1826418740 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v65) ==== 150+0+0 (secure 0 0 0) 0x7f5904063800 con 0x7f58f8005300 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 msgr2=0x7f58f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 0x7f58f007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f59101e6a40 tx=0x7f58fc00f4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 msgr2=0x7f59101f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59040066b0 tx=0x7f59040039c0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 shutdown_connections 2024-09-17T03:14:18.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f58f0078b90 0x7f58f007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59101e5db0 0x7f59101e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5910153e40 0x7f5910154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 --2- 172.21.15.153:0/1826418740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f8005300 0x7f59101f86c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 >> 172.21.15.153:0/1826418740 conn(0x7f59100cca40 msgr2=0x7f59100cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 shutdown_connections 2024-09-17T03:14:18.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.350+0000 7f5917c00640 1 -- 172.21.15.153:0/1826418740 wait complete. 2024-09-17T03:14:18.370 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:14:18.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 -- 172.21.15.153:0/3500253648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea815f5a0 msgr2=0x7f9ea815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 --2- 172.21.15.153:0/3500253648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea815f5a0 0x7f9ea815f9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8072560 tx=0x7f9ea002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 -- 172.21.15.153:0/3500253648 shutdown_connections 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 --2- 172.21.15.153:0/3500253648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea815f5a0 0x7f9ea815f9b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 --2- 172.21.15.153:0/3500253648 >> v2:172.21.15.164:3300/0 conn(0x7f9ea815b9f0 0x7f9ea80cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 -- 172.21.15.153:0/3500253648 >> 172.21.15.153:0/3500253648 conn(0x7f9ea80cca40 msgr2=0x7f9ea80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 -- 172.21.15.153:0/3500253648 shutdown_connections 2024-09-17T03:14:18.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.592+0000 7f9eb0000640 1 -- 172.21.15.153:0/3500253648 wait complete. 2024-09-17T03:14:18.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.594+0000 7f9eb0000640 1 Processor -- start 2024-09-17T03:14:18.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.595+0000 7f9eb0000640 1 -- start start 2024-09-17T03:14:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ea815b9f0 0x7f9ea81f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ea815f5a0 0x7f9ea80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea806df70 con 0x7f9ea80cefa0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea806ddf0 con 0x7f9ea815b9f0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eb0000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea806e0f0 con 0x7f9ea815f5a0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9ead600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9ead600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32928/0 (socket says 172.21.15.153:32928) 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9ead600640 1 -- 172.21.15.153:0/417823998 learned_addr learned my addr 172.21.15.153:0/417823998 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.596+0000 7f9eacc00640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ea815b9f0 0x7f9ea81f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9eae000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ea815f5a0 0x7f9ea80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 -- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ea815f5a0 msgr2=0x7f9ea80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ea815f5a0 0x7f9ea80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 -- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ea815b9f0 msgr2=0x7f9ea81f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ea815b9f0 0x7f9ea81f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 -- 172.21.15.153:0/417823998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81f6430 con 0x7f9ea80cefa0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ead600640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00d7a0 tx=0x7f9e9c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c017070 con 0x7f9ea80cefa0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e9c009d20 con 0x7f9ea80cefa0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea8158120 con 0x7f9ea80cefa0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.597+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c004280 con 0x7f9ea80cefa0 2024-09-17T03:14:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.598+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea81586e0 con 0x7f9ea80cefa0 2024-09-17T03:14:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.598+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea80ce700 con 0x7f9ea80cefa0 2024-09-17T03:14:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.600+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e9c005020 con 0x7f9ea80cefa0 2024-09-17T03:14:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.601+0000 7f9ea5600640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 0x7f9e8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.601+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f9e9c09b500 con 0x7f9ea80cefa0 2024-09-17T03:14:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.601+0000 7f9eacc00640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 0x7f9e8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.602+0000 7f9eacc00640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 0x7f9e8807b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c9e30 tx=0x7f9e94009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.605+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ea80ce700 con 0x7f9ea80cefa0 2024-09-17T03:14:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.789+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9ea815ab70 con 0x7f9ea80cefa0 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.790+0000 7f9ea5600640 1 -- 172.21.15.153:0/417823998 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f9ea815ab70 con 0x7f9ea80cefa0 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_client 20/20 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:14:18.789 INFO:teuthology.orchestra.run.smithi153.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3069.500150 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4708.762151 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3081.880144 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3108.202497 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4146.914538 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4162.753164 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7325.320731 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4012.872074 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds 20/20 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_ms 2/2 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_frag true 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_verify_scatter true 2024-09-17T03:14:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced client_mount_timeout 600 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_client 20/20 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_ms 1/1 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:14:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 msgr2=0x7f9e8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 0x7f9e8807b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c9e30 tx=0x7f9e94009040 comp rx=0 tx=0).stop 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 msgr2=0x7f9ea80b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00d7a0 tx=0x7f9e9c00dc60 comp rx=0 tx=0).stop 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 shutdown_connections 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e88078bc0 0x7f9e8807b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ea815f5a0 0x7f9ea80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ea815b9f0 0x7f9ea81f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 --2- 172.21.15.153:0/417823998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ea80cefa0 0x7f9ea80b1030 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 >> 172.21.15.153:0/417823998 conn(0x7f9ea80cca40 msgr2=0x7f9ea806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 shutdown_connections 2024-09-17T03:14:18.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:18.792+0000 7f9eb0000640 1 -- 172.21.15.153:0/417823998 wait complete. 2024-09-17T03:14:18.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:14:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 -- 172.21.15.153:0/2085040969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf4005270 msgr2=0x7fbcf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 --2- 172.21.15.153:0/2085040969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf4005270 0x7fbcf400b9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c470 tx=0x7fbcf4005830 comp rx=0 tx=0).stop 2024-09-17T03:14:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd0f200640 1 -- 172.21.15.153:0/2085040969 reap_dead start 2024-09-17T03:14:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 -- 172.21.15.153:0/2085040969 shutdown_connections 2024-09-17T03:14:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 -- 172.21.15.153:0/2085040969 >> 172.21.15.153:0/2085040969 conn(0x7fbd100b1b90 msgr2=0x7fbd100b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 -- 172.21.15.153:0/2085040969 shutdown_connections 2024-09-17T03:14:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.043+0000 7fbd15400640 1 -- 172.21.15.153:0/2085040969 wait complete. 2024-09-17T03:14:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.045+0000 7fbd15400640 1 Processor -- start 2024-09-17T03:14:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.046+0000 7fbd15400640 1 -- start start 2024-09-17T03:14:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf4005270 0x7fbd1015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd10157650 0x7fbd10157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd10070d20 con 0x7fbd10159d70 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd10070ba0 con 0x7fbd10157650 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd15400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbd100cf290 con 0x7fbcf4005270 2024-09-17T03:14:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd05e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd05e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32934/0 (socket says 172.21.15.153:32934) 2024-09-17T03:14:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.047+0000 7fbd05e00640 1 -- 172.21.15.153:0/4041246468 learned_addr learned my addr 172.21.15.153:0/4041246468 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd0e800640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf4005270 0x7fbd1015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd0f200640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd10157650 0x7fbd10157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 -- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf4005270 msgr2=0x7fbd1015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf4005270 0x7fbd1015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 -- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd10157650 msgr2=0x7fbd10157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd10157650 0x7fbd10157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 -- 172.21.15.153:0/4041246468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1015a6c0 con 0x7fbd10159d70 2024-09-17T03:14:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd05e00640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800f9b0 tx=0x7fbcf800fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800bc50 con 0x7fbd10159d70 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf8004030 con 0x7fbd10159d70 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004420 con 0x7fbd10159d70 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.048+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd101e85c0 con 0x7fbd10159d70 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.049+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd101e8b80 con 0x7fbd10159d70 2024-09-17T03:14:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.050+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1015ae80 con 0x7fbd10159d70 2024-09-17T03:14:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.051+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcf80035f0 con 0x7fbd10159d70 2024-09-17T03:14:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.052+0000 7fbd07400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 0x7fbcec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.052+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fbcf809bc10 con 0x7fbd10159d70 2024-09-17T03:14:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.052+0000 7fbd0e800640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 0x7fbcec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.053+0000 7fbd0e800640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 0x7fbcec07b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd00005fd0 tx=0x7fbd00009530 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.056+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd1015a6c0 con 0x7fbd10159d70 2024-09-17T03:14:19.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.240+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbd100b1880 con 0x7fbd10159d70 2024-09-17T03:14:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.245+0000 7fbd07400640 1 -- 172.21.15.153:0/4041246468 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fbcf80635b0 con 0x7fbd10159d70 2024-09-17T03:14:19.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 msgr2=0x7fbcec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 0x7fbcec07b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd00005fd0 tx=0x7fbd00009530 comp rx=0 tx=0).stop 2024-09-17T03:14:19.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 msgr2=0x7fbd1015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800f9b0 tx=0x7fbcf800fe70 comp rx=0 tx=0).stop 2024-09-17T03:14:19.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 shutdown_connections 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbcec078b90 0x7fbcec07b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd10157650 0x7fbd10157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10159d70 0x7fbd1015a180 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 --2- 172.21.15.153:0/4041246468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf4005270 0x7fbd1015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 >> 172.21.15.153:0/4041246468 conn(0x7fbd100b1b90 msgr2=0x7fbd1015b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 shutdown_connections 2024-09-17T03:14:19.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.248+0000 7fbd15400640 1 -- 172.21.15.153:0/4041246468 wait complete. 2024-09-17T03:14:19.272 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:14:19.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:19.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:19.455 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:14:19.455 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:19.455 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:19.491 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:19.491 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:19.566 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:19.566 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:19.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:14:19.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 -- 172.21.15.153:0/2932015636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db8004800 msgr2=0x7f7db8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 --2- 172.21.15.153:0/2932015636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db8004800 0x7f7db8004c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00baf0 tx=0x7f7db8005830 comp rx=0 tx=0).stop 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 -- 172.21.15.153:0/2932015636 shutdown_connections 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 --2- 172.21.15.153:0/2932015636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7db8004800 0x7f7db8004c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 -- 172.21.15.153:0/2932015636 >> 172.21.15.153:0/2932015636 conn(0x7f7dd00b1b90 msgr2=0x7f7dd00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 -- 172.21.15.153:0/2932015636 shutdown_connections 2024-09-17T03:14:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.907+0000 7f7dd7800640 1 -- 172.21.15.153:0/2932015636 wait complete. 2024-09-17T03:14:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.909+0000 7f7dd7800640 1 Processor -- start 2024-09-17T03:14:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.910+0000 7f7dd7800640 1 -- start start 2024-09-17T03:14:19.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7db8004800 0x7f7dd00c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7dd00c7150 0x7f7dd015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd006e380 con 0x7f7dd01f30c0 2024-09-17T03:14:19.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd006e200 con 0x7f7dd00c7150 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd7800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd006e500 con 0x7f7db8004800 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd5800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd5800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32956/0 (socket says 172.21.15.153:32956) 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.911+0000 7f7dd5800640 1 -- 172.21.15.153:0/19320309 learned_addr learned my addr 172.21.15.153:0/19320309 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dcfe00640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7dd00c7150 0x7f7dd015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd4e00640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7db8004800 0x7f7dd00c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 -- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7db8004800 msgr2=0x7f7dd00c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7db8004800 0x7f7dd00c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 -- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7dd00c7150 msgr2=0x7f7dd015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7dd00c7150 0x7f7dd015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 -- 172.21.15.153:0/19320309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00c78a0 con 0x7f7dd01f30c0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd5800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00af930 tx=0x7f7dc8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011900 con 0x7f7dd01f30c0 2024-09-17T03:14:19.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dc8018070 con 0x7f7dd01f30c0 2024-09-17T03:14:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd00c9280 con 0x7f7dd01f30c0 2024-09-17T03:14:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d60 con 0x7f7dd01f30c0 2024-09-17T03:14:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.912+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd00c9840 con 0x7f7dd01f30c0 2024-09-17T03:14:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.913+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd00749a0 con 0x7f7dd01f30c0 2024-09-17T03:14:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.915+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7dc801d460 con 0x7f7dd01f30c0 2024-09-17T03:14:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.916+0000 7f7dccc00640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 0x7f7db007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.916+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f7dc809baa0 con 0x7f7dd01f30c0 2024-09-17T03:14:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.916+0000 7f7dd4e00640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 0x7f7db007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.917+0000 7f7dd4e00640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 0x7f7db007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4000fb0 tx=0x7f7dc4006970 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:19.920+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7dc8063440 con 0x7f7dd01f30c0 2024-09-17T03:14:20.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.114+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7dd00b24d0 con 0x7f7dd01f30c0 2024-09-17T03:14:20.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.114+0000 7f7dccc00640 1 -- 172.21.15.153:0/19320309 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f7dc8067e70 con 0x7f7dd01f30c0 2024-09-17T03:14:20.113 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 msgr2=0x7f7db007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 0x7f7db007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4000fb0 tx=0x7f7dc4006970 comp rx=0 tx=0).stop 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 msgr2=0x7f7dd00b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00af930 tx=0x7f7dc8006430 comp rx=0 tx=0).stop 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 shutdown_connections 2024-09-17T03:14:20.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7db0078bc0 0x7f7db007b0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dd01f30c0 0x7f7dd00b35f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7dd00c7150 0x7f7dd015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 --2- 172.21.15.153:0/19320309 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7db8004800 0x7f7dd00c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 >> 172.21.15.153:0/19320309 conn(0x7f7dd00b1b90 msgr2=0x7f7dd00cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 shutdown_connections 2024-09-17T03:14:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.117+0000 7f7dd7800640 1 -- 172.21.15.153:0/19320309 wait complete. 2024-09-17T03:14:20.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:14:20.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:20.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T03:14:20.199 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:14:20.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:20.199 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:14:20.236 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:20.236 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:20.276 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:20.277 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:20.356 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:20.356 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:20.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:14:20.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 -- 172.21.15.153:0/74542763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c4074b60 msgr2=0x7f30c406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 --2- 172.21.15.153:0/74542763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c4074b60 0x7f30c406ddf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009830 tx=0x7f30ac02a510 comp rx=0 tx=0).stop 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 -- 172.21.15.153:0/74542763 shutdown_connections 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 --2- 172.21.15.153:0/74542763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c4074b60 0x7f30c406ddf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 --2- 172.21.15.153:0/74542763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 0x7f30c4074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 -- 172.21.15.153:0/74542763 >> 172.21.15.153:0/74542763 conn(0x7f30c40b1b90 msgr2=0x7f30c40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 -- 172.21.15.153:0/74542763 shutdown_connections 2024-09-17T03:14:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.659+0000 7f30ca000640 1 -- 172.21.15.153:0/74542763 wait complete. 2024-09-17T03:14:20.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.661+0000 7f30ca000640 1 Processor -- start 2024-09-17T03:14:20.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.662+0000 7f30ca000640 1 -- start start 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c4074b60 0x7f30c40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 0x7f30c4155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30c40ce500 con 0x7f30c406e330 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30c40ce380 con 0x7f30c4074b60 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30ca000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f30c40ce680 con 0x7f30c4156a50 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30c3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30c3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32974/0 (socket says 172.21.15.153:32974) 2024-09-17T03:14:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30c3400640 1 -- 172.21.15.153:0/252704987 learned_addr learned my addr 172.21.15.153:0/252704987 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30c3e00640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 0x7f30c4155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.663+0000 7f30baa00640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c4074b60 0x7f30c40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 -- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 msgr2=0x7f30c4155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 0x7f30c4155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 -- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c4074b60 msgr2=0x7f30c40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c4074b60 0x7f30c40c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 -- 172.21.15.153:0/252704987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c40b3f20 con 0x7f30c406e330 2024-09-17T03:14:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30c3400640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f30b400e790 tx=0x7f30b400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b400eea0 con 0x7f30c406e330 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30b400cdb0 con 0x7f30c406e330 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.664+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c40b4200 con 0x7f30c406e330 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.665+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4010690 con 0x7f30c406e330 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.665+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c40b47c0 con 0x7f30c406e330 2024-09-17T03:14:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.666+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c406ddf0 con 0x7f30c406e330 2024-09-17T03:14:20.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.667+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30b4010830 con 0x7f30c406e330 2024-09-17T03:14:20.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.668+0000 7f30bbe00640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.668+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f30b409ba40 con 0x7f30c406e330 2024-09-17T03:14:20.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.668+0000 7f30baa00640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.669+0000 7f30baa00640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 0x7f30a007b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30ac034000 tx=0x7f30ac004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.672+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30b4063480 con 0x7f30c406e330 2024-09-17T03:14:20.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.869+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30c4160320 con 0x7f30c406e330 2024-09-17T03:14:20.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.869+0000 7f30bbe00640 1 -- 172.21.15.153:0/252704987 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f30b409be20 con 0x7f30c406e330 2024-09-17T03:14:20.868 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:14:20.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 msgr2=0x7f30a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 0x7f30a007b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30ac034000 tx=0x7f30ac004730 comp rx=0 tx=0).stop 2024-09-17T03:14:20.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 msgr2=0x7f30c4158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f30b400e790 tx=0x7f30b400ec50 comp rx=0 tx=0).stop 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 shutdown_connections 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30c4156a50 0x7f30c4155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c4074b60 0x7f30c40c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 --2- 172.21.15.153:0/252704987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c406e330 0x7f30c4158fc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 >> 172.21.15.153:0/252704987 conn(0x7f30c40b1b90 msgr2=0x7f30c40b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 shutdown_connections 2024-09-17T03:14:20.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:20.872+0000 7f30ca000640 1 -- 172.21.15.153:0/252704987 wait complete. 2024-09-17T03:14:20.893 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:14:20.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:20.894 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T03:14:20.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:14:20.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:20.963 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:14:21.018 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:21.018 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.054 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:21.054 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.130 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:21.130 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.206 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:14:21.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 -- 172.21.15.153:0/2183706260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4156a50 msgr2=0x7f9ff4074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/2183706260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4156a50 0x7f9ff4074620 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b2a20 tx=0x7f9fe402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 -- 172.21.15.153:0/2183706260 shutdown_connections 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/2183706260 >> v2:172.21.15.164:3300/0 conn(0x7f9ff406e330 0x7f9ff40cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/2183706260 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4074b60 0x7f9ff406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/2183706260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4156a50 0x7f9ff4074620 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 -- 172.21.15.153:0/2183706260 >> 172.21.15.153:0/2183706260 conn(0x7f9ff40b1b90 msgr2=0x7f9ff40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 -- 172.21.15.153:0/2183706260 shutdown_connections 2024-09-17T03:14:21.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.470+0000 7f9ff9a00640 1 -- 172.21.15.153:0/2183706260 wait complete. 2024-09-17T03:14:21.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.473+0000 7f9ff9a00640 1 Processor -- start 2024-09-17T03:14:21.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.473+0000 7f9ff9a00640 1 -- start start 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ff406e330 0x7f9ff40c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4156a50 0x7f9ff41f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40ce330 con 0x7f9ff4074b60 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40ce1b0 con 0x7f9ff406e330 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff9a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff40ce4b0 con 0x7f9ff4156a50 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff2000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33000/0 (socket says 172.21.15.153:33000) 2024-09-17T03:14:21.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.474+0000 7f9ff2000640 1 -- 172.21.15.153:0/3506795851 learned_addr learned my addr 172.21.15.153:0/3506795851 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ff406e330 0x7f9ff40c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff3400640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4156a50 0x7f9ff41f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 -- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4156a50 msgr2=0x7f9ff41f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4156a50 0x7f9ff41f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 -- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ff406e330 msgr2=0x7f9ff40c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ff406e330 0x7f9ff40c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 -- 172.21.15.153:0/3506795851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff415a410 con 0x7f9ff4074b60 2024-09-17T03:14:21.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9ff2000640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000d6d0 tx=0x7f9fe000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:21.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.475+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0017070 con 0x7f9ff4074b60 2024-09-17T03:14:21.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.476+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fe0005330 con 0x7f9ff4074b60 2024-09-17T03:14:21.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.476+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff40b3fc0 con 0x7f9ff4074b60 2024-09-17T03:14:21.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.476+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0009820 con 0x7f9ff4074b60 2024-09-17T03:14:21.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.476+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff40b4580 con 0x7f9ff4074b60 2024-09-17T03:14:21.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.477+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff415a180 con 0x7f9ff4074b60 2024-09-17T03:14:21.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.478+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fe0009bd0 con 0x7f9ff4074b60 2024-09-17T03:14:21.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.480+0000 7f9feaa00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 0x7f9fd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:21.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.480+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f9fe009b390 con 0x7f9ff4074b60 2024-09-17T03:14:21.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.480+0000 7f9ff2a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 0x7f9fd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:21.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.481+0000 7f9ff2a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 0x7f9fd407b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4033000 tx=0x7f9fe4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:21.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.484+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fe0062dc0 con 0x7f9ff4074b60 2024-09-17T03:14:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.680+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ff41609f0 con 0x7f9ff4074b60 2024-09-17T03:14:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.681+0000 7f9feaa00640 1 -- 172.21.15.153:0/3506795851 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f9fe00677f0 con 0x7f9ff4074b60 2024-09-17T03:14:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:14:21.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 msgr2=0x7f9fd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 0x7f9fd407b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4033000 tx=0x7f9fe4004730 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 msgr2=0x7f9ff4158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000d6d0 tx=0x7f9fe000db90 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 shutdown_connections 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9fd4078b90 0x7f9fd407b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ff4156a50 0x7f9ff41f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ff4074b60 0x7f9ff4158370 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 --2- 172.21.15.153:0/3506795851 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ff406e330 0x7f9ff40c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 >> 172.21.15.153:0/3506795851 conn(0x7f9ff40b1b90 msgr2=0x7f9ff4155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 shutdown_connections 2024-09-17T03:14:21.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:21.683+0000 7f9ff9a00640 1 -- 172.21.15.153:0/3506795851 wait complete. 2024-09-17T03:14:21.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T03:14:21.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:21.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T03:14:21.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:14:21.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:21.763 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T03:14:21.799 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:21.799 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.840 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:21.840 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.918 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:14:21.918 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:21.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 -- 172.21.15.153:0/1497028814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea406e500 msgr2=0x7f3ea40ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 --2- 172.21.15.153:0/1497028814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea406e500 0x7f3ea40ce510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4075240 tx=0x7f3e9c02aa10 comp rx=0 tx=0).stop 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 -- 172.21.15.153:0/1497028814 shutdown_connections 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 --2- 172.21.15.153:0/1497028814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea406e500 0x7f3ea40ce510 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 --2- 172.21.15.153:0/1497028814 >> v2:172.21.15.164:3300/0 conn(0x7f3ea40cc530 0x7f3ea415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 -- 172.21.15.153:0/1497028814 >> 172.21.15.153:0/1497028814 conn(0x7f3ea40b1b90 msgr2=0x7f3ea40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 -- 172.21.15.153:0/1497028814 shutdown_connections 2024-09-17T03:14:22.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.224+0000 7f3ea9000640 1 -- 172.21.15.153:0/1497028814 wait complete. 2024-09-17T03:14:22.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.226+0000 7f3ea9000640 1 Processor -- start 2024-09-17T03:14:22.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.227+0000 7f3ea9000640 1 -- start start 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ea40cc530 0x7f3ea40ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ea41609e0 0x7f3ea4160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40cec10 con 0x7f3ea40af5b0 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40cea90 con 0x7f3ea41609e0 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea9000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea40ced90 con 0x7f3ea40cc530 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33004/0 (socket says 172.21.15.153:33004) 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea1e00640 1 -- 172.21.15.153:0/3826096994 learned_addr learned my addr 172.21.15.153:0/3826096994 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.228+0000 7f3ea2800640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ea41609e0 0x7f3ea4160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3e9be00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ea40cc530 0x7f3ea40ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 -- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ea40cc530 msgr2=0x7f3ea40ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ea40cc530 0x7f3ea40ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 -- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ea41609e0 msgr2=0x7f3ea4160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ea41609e0 0x7f3ea4160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 -- 172.21.15.153:0/3826096994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea4161330 con 0x7f3ea40af5b0 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea1e00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c970 tx=0x7f3e9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94007bb0 con 0x7f3ea40af5b0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e94007e40 con 0x7f3ea40af5b0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.229+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41f5570 con 0x7f3ea40af5b0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.230+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400f690 con 0x7f3ea40af5b0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.230+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41f5b30 con 0x7f3ea40af5b0 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.231+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea40ce510 con 0x7f3ea40af5b0 2024-09-17T03:14:22.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.232+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e9400f830 con 0x7f3ea40af5b0 2024-09-17T03:14:22.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.233+0000 7f3e9a000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 0x7f3e8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.233+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f3e9409b8c0 con 0x7f3ea40af5b0 2024-09-17T03:14:22.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.233+0000 7f3e9be00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 0x7f3e8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.234+0000 7f3e9be00640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 0x7f3e8007b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ea409ad30 tx=0x7f3e8c009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.237+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ea4161330 con 0x7f3ea40af5b0 2024-09-17T03:14:22.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.434+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3ea406a750 con 0x7f3ea40af5b0 2024-09-17T03:14:22.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.434+0000 7f3e9a000640 1 -- 172.21.15.153:0/3826096994 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f3e94014030 con 0x7f3ea40af5b0 2024-09-17T03:14:22.434 INFO:teuthology.orchestra.run.smithi153.stderr:listed 0 entries 2024-09-17T03:14:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 msgr2=0x7f3e8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 0x7f3e8007b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ea409ad30 tx=0x7f3e8c009060 comp rx=0 tx=0).stop 2024-09-17T03:14:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 msgr2=0x7f3ea41f93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c970 tx=0x7f3e9400ce30 comp rx=0 tx=0).stop 2024-09-17T03:14:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 shutdown_connections 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3e80078b90 0x7f3e8007b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ea41609e0 0x7f3ea4160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ea40cc530 0x7f3ea40ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 --2- 172.21.15.153:0/3826096994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea40af5b0 0x7f3ea41f93d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 >> 172.21.15.153:0/3826096994 conn(0x7f3ea40b1b90 msgr2=0x7f3ea4070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 shutdown_connections 2024-09-17T03:14:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.437+0000 7f3ea9000640 1 -- 172.21.15.153:0/3826096994 wait complete. 2024-09-17T03:14:22.462 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T03:14:22.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:22.462 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T03:14:22.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:14:22.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:22.526 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T03:14:22.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:22.563 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:14:22.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:22.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 -- 172.21.15.153:0/959517772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30006e500 msgr2=0x7fb3000cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 --2- 172.21.15.153:0/959517772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30006e500 0x7fb3000cc020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005fd0 tx=0x7fb2fc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 -- 172.21.15.153:0/959517772 shutdown_connections 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 --2- 172.21.15.153:0/959517772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb30006e500 0x7fb3000cc020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 --2- 172.21.15.153:0/959517772 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb300074cb0 0x7fb300073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.789+0000 7fb308800640 1 -- 172.21.15.153:0/959517772 >> 172.21.15.153:0/959517772 conn(0x7fb3000cca40 msgr2=0x7fb3000cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.790+0000 7fb308800640 1 -- 172.21.15.153:0/959517772 shutdown_connections 2024-09-17T03:14:22.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.790+0000 7fb308800640 1 -- 172.21.15.153:0/959517772 wait complete. 2024-09-17T03:14:22.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.792+0000 7fb308800640 1 Processor -- start 2024-09-17T03:14:22.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.792+0000 7fb308800640 1 -- start start 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3000cbc10 0x7fb3000a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 0x7fb3001e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb30006f360 con 0x7fb300074cb0 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb30006f1e0 con 0x7fb3000a0690 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.793+0000 7fb308800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb30006f4e0 con 0x7fb3000cbc10 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33020/0 (socket says 172.21.15.153:33020) 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 -- 172.21.15.153:0/3619467559 learned_addr learned my addr 172.21.15.153:0/3619467559 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305400640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3000cbc10 0x7fb3000a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb306800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 0x7fb3001e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 -- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3000cbc10 msgr2=0x7fb3000a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3000cbc10 0x7fb3000a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 -- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 msgr2=0x7fb3001e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 0x7fb3001e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 -- 172.21.15.153:0/3619467559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3000cdd70 con 0x7fb300074cb0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb306800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 0x7fb3001e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb305e00640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400e790 tx=0x7fb2f400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.794+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400eea0 con 0x7fb300074cb0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.795+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2f400ccc0 con 0x7fb300074cb0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.795+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3000ce050 con 0x7fb300074cb0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.795+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4004280 con 0x7fb300074cb0 2024-09-17T03:14:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.795+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3000ce610 con 0x7fb300074cb0 2024-09-17T03:14:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.796+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30006acf0 con 0x7fb300074cb0 2024-09-17T03:14:22.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.797+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2f40035f0 con 0x7fb300074cb0 2024-09-17T03:14:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.798+0000 7fb2fa000640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 0x7fb2e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.798+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fb2f409bc30 con 0x7fb300074cb0 2024-09-17T03:14:22.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.799+0000 7fb305400640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 0x7fb2e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.799+0000 7fb305400640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 0x7fb2e407b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0007fd0 tx=0x7fb2f0001390 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:22.801+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb30006acf0 con 0x7fb300074cb0 2024-09-17T03:14:23.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.018+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb30006fa00 con 0x7fb300074cb0 2024-09-17T03:14:23.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.019+0000 7fb2fa000640 1 -- 172.21.15.153:0/3619467559 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fb2f4063ca0 con 0x7fb300074cb0 2024-09-17T03:14:23.018 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:23.019 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:23.019 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.021+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 msgr2=0x7fb2e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.021+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 0x7fb2e407b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0007fd0 tx=0x7fb2f0001390 comp rx=0 tx=0).stop 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 msgr2=0x7fb3000b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400e790 tx=0x7fb2f400ec50 comp rx=0 tx=0).stop 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 shutdown_connections 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2e4078bc0 0x7fb2e407b0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3000a0690 0x7fb3001e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3000cbc10 0x7fb3000a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 --2- 172.21.15.153:0/3619467559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb300074cb0 0x7fb3000b0a50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 >> 172.21.15.153:0/3619467559 conn(0x7fb3000cca40 msgr2=0x7fb300157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 shutdown_connections 2024-09-17T03:14:23.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.022+0000 7fb308800640 1 -- 172.21.15.153:0/3619467559 wait complete. 2024-09-17T03:14:23.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:23.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 -- 172.21.15.153:0/2767595848 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe830074cb0 msgr2=0x7fe81400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 --2- 172.21.15.153:0/2767595848 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe830074cb0 0x7fe81400b9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe828001830 tx=0x7fe814005830 comp rx=0 tx=0).stop 2024-09-17T03:14:23.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe834a00640 1 -- 172.21.15.153:0/2767595848 reap_dead start 2024-09-17T03:14:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 -- 172.21.15.153:0/2767595848 shutdown_connections 2024-09-17T03:14:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 -- 172.21.15.153:0/2767595848 >> 172.21.15.153:0/2767595848 conn(0x7fe8300cca40 msgr2=0x7fe8300cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 -- 172.21.15.153:0/2767595848 shutdown_connections 2024-09-17T03:14:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.266+0000 7fe836a00640 1 -- 172.21.15.153:0/2767595848 wait complete. 2024-09-17T03:14:23.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.268+0000 7fe836a00640 1 Processor -- start 2024-09-17T03:14:23.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.268+0000 7fe836a00640 1 -- start start 2024-09-17T03:14:23.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8301584b0 0x7fe8300a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8300cde30 0x7fe8300ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8300cc1a0 con 0x7fe830074cb0 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe8300cc020 con 0x7fe8300cde30 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe836a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe8300cc320 con 0x7fe8301584b0 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33042/0 (socket says 172.21.15.153:33042) 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 -- 172.21.15.153:0/262030936 learned_addr learned my addr 172.21.15.153:0/262030936 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe827400640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8301584b0 0x7fe8300a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe834a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8300cde30 0x7fe8300ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 -- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8301584b0 msgr2=0x7fe8300a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8301584b0 0x7fe8300a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 -- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8300cde30 msgr2=0x7fe8300ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8300cde30 0x7fe8300ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.270+0000 7fe82fe00640 1 -- 172.21.15.153:0/262030936 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8300a0fc0 con 0x7fe830074cb0 2024-09-17T03:14:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe82fe00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe820011cb0 tx=0x7fe82000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820003e40 con 0x7fe830074cb0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe820004050 con 0x7fe830074cb0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820004440 con 0x7fe830074cb0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8300ce780 con 0x7fe830074cb0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.271+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe830156da0 con 0x7fe830074cb0 2024-09-17T03:14:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.272+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83015b730 con 0x7fe830074cb0 2024-09-17T03:14:23.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.273+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8200045e0 con 0x7fe830074cb0 2024-09-17T03:14:23.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.274+0000 7fe82cc00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 0x7fe80c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.274+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7fe82009c660 con 0x7fe830074cb0 2024-09-17T03:14:23.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.275+0000 7fe827400640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 0x7fe80c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.275+0000 7fe827400640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 0x7fe80c07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8301ec580 tx=0x7fe818001110 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.278+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe83015b730 con 0x7fe830074cb0 2024-09-17T03:14:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.498+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe830050f60 con 0x7fe830074cb0 2024-09-17T03:14:23.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.498+0000 7fe82cc00640 1 -- 172.21.15.153:0/262030936 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fe830050f60 con 0x7fe830074cb0 2024-09-17T03:14:23.497 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:23.498 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:23.498 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:23.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 msgr2=0x7fe80c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 0x7fe80c07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8301ec580 tx=0x7fe818001110 comp rx=0 tx=0).stop 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 msgr2=0x7fe8301f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe820011cb0 tx=0x7fe82000f790 comp rx=0 tx=0).stop 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 shutdown_connections 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe80c078bc0 0x7fe80c07b0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8300cde30 0x7fe8300ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8301584b0 0x7fe8300a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 --2- 172.21.15.153:0/262030936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe830074cb0 0x7fe8301f5fa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 >> 172.21.15.153:0/262030936 conn(0x7fe8300cca40 msgr2=0x7fe830150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 shutdown_connections 2024-09-17T03:14:23.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.501+0000 7fe836a00640 1 -- 172.21.15.153:0/262030936 wait complete. 2024-09-17T03:14:23.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:23.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 -- 172.21.15.153:0/4072479061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c073dd0 msgr2=0x7f964c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 --2- 172.21.15.153:0/4072479061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c073dd0 0x7f964c06ddf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9634005fd0 tx=0x7f963402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 -- 172.21.15.153:0/4072479061 shutdown_connections 2024-09-17T03:14:23.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 --2- 172.21.15.153:0/4072479061 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c06e330 0x7f964c06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 --2- 172.21.15.153:0/4072479061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c073dd0 0x7f964c06ddf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 -- 172.21.15.153:0/4072479061 >> 172.21.15.153:0/4072479061 conn(0x7f964c0cca40 msgr2=0x7f964c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 -- 172.21.15.153:0/4072479061 shutdown_connections 2024-09-17T03:14:23.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.750+0000 7f9652a00640 1 -- 172.21.15.153:0/4072479061 wait complete. 2024-09-17T03:14:23.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.752+0000 7f9652a00640 1 Processor -- start 2024-09-17T03:14:23.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.753+0000 7f9652a00640 1 -- start start 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c073dd0 0x7f964c09e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f964c074cb0 0x7f964c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f964c06f4a0 con 0x7f964c06e330 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f964c06f320 con 0x7f964c074cb0 2024-09-17T03:14:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9652a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f964c06f620 con 0x7f964c073dd0 2024-09-17T03:14:23.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f964be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f964be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33066/0 (socket says 172.21.15.153:33066) 2024-09-17T03:14:23.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f964be00640 1 -- 172.21.15.153:0/1616229290 learned_addr learned my addr 172.21.15.153:0/1616229290 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:23.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9643400640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c073dd0 0x7f964c09e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.754+0000 7f9650a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f964c074cb0 0x7f964c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 -- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c073dd0 msgr2=0x7f964c09e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c073dd0 0x7f964c09e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 -- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f964c074cb0 msgr2=0x7f964c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f964c074cb0 0x7f964c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 -- 172.21.15.153:0/1616229290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c1f78e0 con 0x7f964c06e330 2024-09-17T03:14:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f964be00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c3a0 tx=0x7f963c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c017070 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f963c0053c0 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c0a0ae0 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c003850 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.755+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c0a10a0 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.756+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c06acf0 con 0x7f964c06e330 2024-09-17T03:14:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.758+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f963c01a070 con 0x7f964c06e330 2024-09-17T03:14:23.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.759+0000 7f9648c00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 0x7f962807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.759+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f963c09a360 con 0x7f964c06e330 2024-09-17T03:14:23.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.759+0000 7f9643400640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 0x7f962807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.760+0000 7f9643400640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 0x7f962807b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9634033000 tx=0x7f9634004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.763+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f963c061d90 con 0x7f964c06e330 2024-09-17T03:14:23.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.947+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f964c06fbb0 con 0x7f964c06e330 2024-09-17T03:14:23.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.948+0000 7f9648c00640 1 -- 172.21.15.153:0/1616229290 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18826 (secure 0 0 0) 0x7f963c0667c0 con 0x7f964c06e330 2024-09-17T03:14:23.947 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:23.948 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":29,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:12.317547+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.950+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 msgr2=0x7f962807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.950+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 0x7f962807b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9634033000 tx=0x7f9634004730 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.950+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 msgr2=0x7f964c1f73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.950+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c3a0 tx=0x7f963c00c860 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 shutdown_connections 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9628078b90 0x7f962807b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f964c074cb0 0x7f964c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f964c073dd0 0x7f964c09e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 --2- 172.21.15.153:0/1616229290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f964c06e330 0x7f964c1f73a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 >> 172.21.15.153:0/1616229290 conn(0x7f964c0cca40 msgr2=0x7f964c0ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 shutdown_connections 2024-09-17T03:14:23.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:23.951+0000 7f9652a00640 1 -- 172.21.15.153:0/1616229290 wait complete. 2024-09-17T03:14:23.971 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:14:23.971 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 -- 172.21.15.153:0/392806895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f40d2520 msgr2=0x7f99f40b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 --2- 172.21.15.153:0/392806895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f40d2520 0x7f99f40b82f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99f4162100 tx=0x7f99ec02a9a0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 -- 172.21.15.153:0/392806895 shutdown_connections 2024-09-17T03:14:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 --2- 172.21.15.153:0/392806895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f40d2520 0x7f99f40b82f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 --2- 172.21.15.153:0/392806895 >> v2:172.21.15.164:3300/0 conn(0x7f99f40cfbc0 0x7f99f415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 -- 172.21.15.153:0/392806895 >> 172.21.15.153:0/392806895 conn(0x7f99f40d4360 msgr2=0x7f99f40d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 -- 172.21.15.153:0/392806895 shutdown_connections 2024-09-17T03:14:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.193+0000 7f99f3200640 1 -- 172.21.15.153:0/392806895 wait complete. 2024-09-17T03:14:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.195+0000 7f99f3200640 1 Processor -- start 2024-09-17T03:14:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.195+0000 7f99f3200640 1 -- start start 2024-09-17T03:14:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40ceff0 0x7f99f41f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99f40d2520 0x7f99f40ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40b8db0 con 0x7f99f414ecd0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40b8c30 con 0x7f99f40ceff0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f3200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f99f40b8f30 con 0x7f99f40d2520 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40018/0 (socket says 172.21.15.153:40018) 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f2800640 1 -- 172.21.15.153:0/1361582811 learned_addr learned my addr 172.21.15.153:0/1361582811 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99f1e00640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40ceff0 0x7f99f41f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.197+0000 7f99e9400640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99f40d2520 0x7f99f40ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 -- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99f40d2520 msgr2=0x7f99f40ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99f40d2520 0x7f99f40ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 -- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40ceff0 msgr2=0x7f99f41f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40ceff0 0x7f99f41f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 -- 172.21.15.153:0/1361582811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f41f8ba0 con 0x7f99f414ecd0 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f2800640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02af90 tx=0x7f99ec003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec033050 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99ec004450 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f414e4f0 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec004860 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.198+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f41f9390 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.199+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f41f8e20 con 0x7f99f414ecd0 2024-09-17T03:14:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.201+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99ec036070 con 0x7f99f414ecd0 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.201+0000 7f99eaa00640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 0x7f99d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.202+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f99ec0bc300 con 0x7f99f414ecd0 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.202+0000 7f99f1e00640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 0x7f99d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.202+0000 7f99f1e00640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 0x7f99d007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001720 tx=0x7f99e4009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.206+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99ec083cb0 con 0x7f99f414ecd0 2024-09-17T03:14:24.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.424+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99f40b94c0 con 0x7f99f414ecd0 2024-09-17T03:14:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.425+0000 7f99eaa00640 1 -- 172.21.15.153:0/1361582811 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f99ec0886e0 con 0x7f99f414ecd0 2024-09-17T03:14:24.424 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:24.424 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:24.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 msgr2=0x7f99d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 0x7f99d007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001720 tx=0x7f99e4009040 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 msgr2=0x7f99f414c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02af90 tx=0x7f99ec003ef0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 shutdown_connections 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f99d0078b90 0x7f99d007b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f414ecd0 0x7f99f414c2e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99f40d2520 0x7f99f40ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 --2- 172.21.15.153:0/1361582811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99f40ceff0 0x7f99f41f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 >> 172.21.15.153:0/1361582811 conn(0x7f99f40d4360 msgr2=0x7f99f415c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 shutdown_connections 2024-09-17T03:14:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.427+0000 7f99f3200640 1 -- 172.21.15.153:0/1361582811 wait complete. 2024-09-17T03:14:24.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 -- 172.21.15.153:0/509531847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29700cbc10 msgr2=0x7f29700cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 --2- 172.21.15.153:0/509531847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29700cbc10 0x7f29700cc020 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2970076360 tx=0x7f295c02a560 comp rx=0 tx=0).stop 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 -- 172.21.15.153:0/509531847 shutdown_connections 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 --2- 172.21.15.153:0/509531847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f297006ddf0 0x7f297006e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 --2- 172.21.15.153:0/509531847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29700cbc10 0x7f29700cc020 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 --2- 172.21.15.153:0/509531847 >> v2:172.21.15.164:3300/0 conn(0x7f2970074cb0 0x7f2970073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 -- 172.21.15.153:0/509531847 >> 172.21.15.153:0/509531847 conn(0x7f29700cca40 msgr2=0x7f29700cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 -- 172.21.15.153:0/509531847 shutdown_connections 2024-09-17T03:14:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.671+0000 7f2977200640 1 -- 172.21.15.153:0/509531847 wait complete. 2024-09-17T03:14:24.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.673+0000 7f2977200640 1 Processor -- start 2024-09-17T03:14:24.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.674+0000 7f2977200640 1 -- start start 2024-09-17T03:14:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f297006ddf0 0x7f29701f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29700cbc10 0x7f297009d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f297006f170 con 0x7f2970074cb0 2024-09-17T03:14:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f297006eff0 con 0x7f297006ddf0 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2977200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f297006f2f0 con 0x7f29700cbc10 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f296f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f296f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40032/0 (socket says 172.21.15.153:40032) 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f296f400640 1 -- 172.21.15.153:0/1284616542 learned_addr learned my addr 172.21.15.153:0/1284616542 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f296fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f297006ddf0 0x7f29701f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.675+0000 7f2975200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29700cbc10 0x7f297009d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 -- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29700cbc10 msgr2=0x7f297009d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29700cbc10 0x7f297009d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 -- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f297006ddf0 msgr2=0x7f29701f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f297006ddf0 0x7f29701f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 -- 172.21.15.153:0/1284616542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2970157720 con 0x7f2970074cb0 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f296f400640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f295c034040 tx=0x7f295c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c03e030 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f295c0047a0 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c035040 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.676+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2970157a00 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.677+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29701581d0 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.677+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2970073dd0 con 0x7f2970074cb0 2024-09-17T03:14:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.679+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f295c041030 con 0x7f2970074cb0 2024-09-17T03:14:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.680+0000 7f2967e00640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 0x7f295007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.680+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f295c0bb920 con 0x7f2970074cb0 2024-09-17T03:14:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.680+0000 7f296fe00640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 0x7f295007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.681+0000 7f296fe00640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 0x7f295007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f297015a730 tx=0x7f296000a2d0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.684+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f295c083360 con 0x7f2970074cb0 2024-09-17T03:14:24.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.900+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2970159280 con 0x7f2970074cb0 2024-09-17T03:14:24.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.901+0000 7f2967e00640 1 -- 172.21.15.153:0/1284616542 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f295c087d90 con 0x7f2970074cb0 2024-09-17T03:14:24.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:24.900 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":9,"btime":"2024-09-17T03:13:51:211074+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4362,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1590994132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1590994132},{"type":"v1","addr":"172.21.15.153:6834","nonce":1590994132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/742634712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":742634712},{"type":"v1","addr":"172.21.15.153:6835","nonce":742634712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/4018150652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":4018150652},{"type":"v1","addr":"172.21.15.164:6836","nonce":4018150652}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:33.601612+0000","modified":"2024-09-17T03:13:50.699040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4371":{"gid":4371,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6837/842621775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":842621775},{"type":"v1","addr":"172.21.15.164:6837","nonce":842621775}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4371,"qdb_cluster":[4371]},"id":1}]} 2024-09-17T03:14:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 9 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 msgr2=0x7f295007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 0x7f295007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f297015a730 tx=0x7f296000a2d0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 msgr2=0x7f297009d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f295c034040 tx=0x7f295c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 shutdown_connections 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2950078b90 0x7f295007b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29700cbc10 0x7f297009d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2970074cb0 0x7f297009d0c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 --2- 172.21.15.153:0/1284616542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f297006ddf0 0x7f29701f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 >> 172.21.15.153:0/1284616542 conn(0x7f29700cca40 msgr2=0x7f297015b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 shutdown_connections 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:24.903+0000 7f2977200640 1 -- 172.21.15.153:0/1284616542 wait complete. 2024-09-17T03:14:24.927 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 -- 172.21.15.153:0/3263963219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 msgr2=0x7f8a34073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3263963219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a34073dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a24005fd0 tx=0x7f8a2402aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 -- 172.21.15.153:0/3263963219 shutdown_connections 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3263963219 >> v2:172.21.15.164:3300/0 conn(0x7f8a340cbc10 0x7f8a340cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3263963219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a34073dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 -- 172.21.15.153:0/3263963219 >> 172.21.15.153:0/3263963219 conn(0x7f8a340cca40 msgr2=0x7f8a340cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 -- 172.21.15.153:0/3263963219 shutdown_connections 2024-09-17T03:14:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.149+0000 7f8a38a00640 1 -- 172.21.15.153:0/3263963219 wait complete. 2024-09-17T03:14:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.151+0000 7f8a38a00640 1 Processor -- start 2024-09-17T03:14:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.151+0000 7f8a38a00640 1 -- start start 2024-09-17T03:14:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a340a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a340cbc10 0x7f8a340a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3406f310 con 0x7f8a3406ddf0 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3406f190 con 0x7f8a340cbc10 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a38a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3406f490 con 0x7f8a34074cb0 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a31e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a31e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40040/0 (socket says 172.21.15.153:40040) 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a31e00640 1 -- 172.21.15.153:0/3131926308 learned_addr learned my addr 172.21.15.153:0/3131926308 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a29400640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a340a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.153+0000 7f8a32800640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a340cbc10 0x7f8a340a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 -- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 msgr2=0x7f8a340a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a340a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 -- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a340cbc10 msgr2=0x7f8a340a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a340cbc10 0x7f8a340a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 -- 172.21.15.153:0/3131926308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3409f700 con 0x7f8a3406ddf0 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a29400640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a340a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a31e00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a24000f80 tx=0x7f8a24003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24004040 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a240041e0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3409f9e0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240045f0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.154+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3409ffa0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.155+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3406f9b0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.157+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a240300d0 con 0x7f8a3406ddf0 2024-09-17T03:14:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.158+0000 7f8a2aa00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 0x7f8a1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.158+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f8a240bc520 con 0x7f8a3406ddf0 2024-09-17T03:14:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.158+0000 7f8a29400640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 0x7f8a1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.159+0000 7f8a29400640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 0x7f8a1007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a3415f2f0 tx=0x7f8a1c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.162+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a24032030 con 0x7f8a3406ddf0 2024-09-17T03:14:25.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.347+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a34074550 con 0x7f8a3406ddf0 2024-09-17T03:14:25.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.348+0000 7f8a2aa00640 1 -- 172.21.15.153:0/3131926308 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18826 (secure 0 0 0) 0x7f8a24083f60 con 0x7f8a3406ddf0 2024-09-17T03:14:25.348 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:25.348 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":29,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:12.317547+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:31.742543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:32.565658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:13:36.143662+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":0,"to":7}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":0}]},{"pgid":"4.14","mappings":[{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 msgr2=0x7f8a1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 0x7f8a1007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a3415f2f0 tx=0x7f8a1c005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 msgr2=0x7f8a3409adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a24000f80 tx=0x7f8a24003ba0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 shutdown_connections 2024-09-17T03:14:25.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8a10078b90 0x7f8a1007b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a340cbc10 0x7f8a340a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a34074cb0 0x7f8a340a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 --2- 172.21.15.153:0/3131926308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3406ddf0 0x7f8a3409adf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 >> 172.21.15.153:0/3131926308 conn(0x7f8a340cca40 msgr2=0x7f8a3415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 shutdown_connections 2024-09-17T03:14:25.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.351+0000 7f8a38a00640 1 -- 172.21.15.153:0/3131926308 wait complete. 2024-09-17T03:14:25.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.595+0000 7f370d000640 1 -- 172.21.15.153:0/1233583149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 msgr2=0x7f36ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.595+0000 7f370d000640 1 --2- 172.21.15.153:0/1233583149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f36ec00b9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3700001f30 tx=0x7f36ec005830 comp rx=0 tx=0).stop 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.595+0000 7f3706800640 1 -- 172.21.15.153:0/1233583149 reap_dead start 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.595+0000 7f370d000640 1 -- 172.21.15.153:0/1233583149 shutdown_connections 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.595+0000 7f370d000640 1 -- 172.21.15.153:0/1233583149 >> 172.21.15.153:0/1233583149 conn(0x7f37080b1b90 msgr2=0x7f37080b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.596+0000 7f370d000640 1 -- 172.21.15.153:0/1233583149 shutdown_connections 2024-09-17T03:14:25.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.596+0000 7f370d000640 1 -- 172.21.15.153:0/1233583149 wait complete. 2024-09-17T03:14:25.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.598+0000 7f370d000640 1 Processor -- start 2024-09-17T03:14:25.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.598+0000 7f370d000640 1 -- start start 2024-09-17T03:14:25.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 0x7f3708159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f370815bb80 0x7f370815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3708160fd0 con 0x7f36ec005210 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3708160e50 con 0x7f3708157070 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.599+0000 7f370d000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f370806e200 con 0x7f370815bb80 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40054/0 (socket says 172.21.15.153:40054) 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 -- 172.21.15.153:0/902864086 learned_addr learned my addr 172.21.15.153:0/902864086 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705400640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 0x7f3708159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3706800640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f370815bb80 0x7f370815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 -- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f370815bb80 msgr2=0x7f370815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f370815bb80 0x7f370815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 -- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 msgr2=0x7f3708159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 0x7f3708159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 -- 172.21.15.153:0/902864086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3708158d70 con 0x7f36ec005210 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705400640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 0x7f3708159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.600+0000 7f3705e00640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36f80035f0 tx=0x7f36f8003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.601+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8015070 con 0x7f36ec005210 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.601+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f800fa60 con 0x7f36ec005210 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.601+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f800fe70 con 0x7f36ec005210 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.601+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3708159050 con 0x7f36ec005210 2024-09-17T03:14:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.601+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3708159610 con 0x7f36ec005210 2024-09-17T03:14:25.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.602+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370815ff30 con 0x7f36ec005210 2024-09-17T03:14:25.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.603+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36f8011430 con 0x7f36ec005210 2024-09-17T03:14:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.604+0000 7f36fe000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 0x7f36e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.604+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6648+0+0 (secure 0 0 0) 0x7f36f809c000 con 0x7f36ec005210 2024-09-17T03:14:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.605+0000 7f3705400640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 0x7f36e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.605+0000 7f3705400640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 0x7f36e807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3708154d70 tx=0x7f36f4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.608+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f370806e740 con 0x7f36ec005210 2024-09-17T03:14:25.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.834+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f37080696c0 con 0x7f36ec005210 2024-09-17T03:14:25.833 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-09-17T03:14:25.835+0000 7f8431a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:14:25.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.837+0000 7f36fe000640 1 -- 172.21.15.153:0/902864086 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f36f8064090 con 0x7f36ec005210 2024-09-17T03:14:25.836 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:14:25.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 msgr2=0x7f36e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 0x7f36e807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3708154d70 tx=0x7f36f4005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 msgr2=0x7f37081f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36f80035f0 tx=0x7f36f8003ab0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 shutdown_connections 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f36e8078b90 0x7f36e807b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f370815bb80 0x7f370815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3708157070 0x7f3708159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 --2- 172.21.15.153:0/902864086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec005210 0x7f37081f6300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.840+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 >> 172.21.15.153:0/902864086 conn(0x7f37080b1b90 msgr2=0x7f37080b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.841+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 shutdown_connections 2024-09-17T03:14:25.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:25.841+0000 7f370d000640 1 -- 172.21.15.153:0/902864086 wait complete. 2024-09-17T03:14:25.851 INFO:tasks.ceph.mds.d.smithi164.stderr: -4895> 2024-09-17T03:13:39.081+0000 7f9022400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:14:25.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:14:25.971 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.089+0000 7f1d4fe00640 1 -- 172.21.15.153:0/3465693944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5006d2b0 msgr2=0x7f1d501621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.089+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/3465693944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5006d2b0 0x7f1d501621d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1d500d0070 tx=0x7f1d4002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 -- 172.21.15.153:0/3465693944 shutdown_connections 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/3465693944 >> v2:172.21.15.164:3300/0 conn(0x7f1d50162710 0x7f1d500cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/3465693944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d5006d2b0 0x7f1d501621d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 -- 172.21.15.153:0/3465693944 >> 172.21.15.153:0/3465693944 conn(0x7f1d500d1960 msgr2=0x7f1d500d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 -- 172.21.15.153:0/3465693944 shutdown_connections 2024-09-17T03:14:26.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.090+0000 7f1d4fe00640 1 -- 172.21.15.153:0/3465693944 wait complete. 2024-09-17T03:14:26.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.092+0000 7f1d4fe00640 1 Processor -- start 2024-09-17T03:14:26.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.092+0000 7f1d4fe00640 1 -- start start 2024-09-17T03:14:26.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5006d2b0 0x7f1d500ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 0x7f1d50159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50155940 con 0x7f1d50162710 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501557c0 con 0x7f1d500cf840 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.093+0000 7f1d4fe00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1d50155ac0 con 0x7f1d5006d2b0 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40082/0 (socket says 172.21.15.153:40082) 2024-09-17T03:14:26.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 -- 172.21.15.153:0/1876550456 learned_addr learned my addr 172.21.15.153:0/1876550456 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:26.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4ea00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5006d2b0 0x7f1d500ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4e000640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 0x7f1d50159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 -- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5006d2b0 msgr2=0x7f1d500ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5006d2b0 0x7f1d500ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 -- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 msgr2=0x7f1d50159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 0x7f1d50159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 -- 172.21.15.153:0/1876550456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5015c5e0 con 0x7f1d50162710 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4e000640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 0x7f1d50159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.094+0000 7f1d4f400640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c730 tx=0x7f1d4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.095+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48003b90 con 0x7f1d50162710 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.095+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d48003d30 con 0x7f1d50162710 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.095+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48005330 con 0x7f1d50162710 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.095+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d50157e40 con 0x7f1d50162710 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.095+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d50158400 con 0x7f1d50162710 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.096+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d501621d0 con 0x7f1d50162710 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.097+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d480056e0 con 0x7f1d50162710 2024-09-17T03:14:26.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.098+0000 7f1d46a00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 0x7f1d3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.098+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6734+0+0 (secure 0 0 0) 0x7f1d4809b150 con 0x7f1d50162710 2024-09-17T03:14:26.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.099+0000 7f1d4ea00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 0x7f1d3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.099+0000 7f1d4ea00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 0x7f1d3007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d40033000 tx=0x7f1d40004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.103+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1d50162b20 con 0x7f1d50162710 2024-09-17T03:14:26.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.332+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1d5006edd0 con 0x7f1d50162710 2024-09-17T03:14:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.839+0000 7f1d46a00640 1 -- 172.21.15.153:0/1876550456 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f1d480630f0 con 0x7f1d50162710 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 msgr2=0x7f1d3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 0x7f1d3007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d40033000 tx=0x7f1d40004730 comp rx=0 tx=0).stop 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 msgr2=0x7f1d50159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800c730 tx=0x7f1d4800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 shutdown_connections 2024-09-17T03:14:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1d30078b90 0x7f1d3007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d50162710 0x7f1d50159c60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d500cf840 0x7f1d50159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 --2- 172.21.15.153:0/1876550456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1d5006d2b0 0x7f1d500ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 >> 172.21.15.153:0/1876550456 conn(0x7f1d500d1960 msgr2=0x7f1d500b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 shutdown_connections 2024-09-17T03:14:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:26.842+0000 7f1d4fe00640 1 -- 172.21.15.153:0/1876550456 wait complete. 2024-09-17T03:14:26.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:14:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 -- 172.21.15.153:0/3770001098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7214145cc0 msgr2=0x7f72140cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 --2- 172.21.15.153:0/3770001098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7214145cc0 0x7f72140cf030 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f720c005fd0 tx=0x7f720c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 -- 172.21.15.153:0/3770001098 shutdown_connections 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 --2- 172.21.15.153:0/3770001098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7214145cc0 0x7f72140cf030 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 --2- 172.21.15.153:0/3770001098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214160670 0x7f72140ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 -- 172.21.15.153:0/3770001098 >> 172.21.15.153:0/3770001098 conn(0x7f72140d0460 msgr2=0x7f721406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.091+0000 7f7213e00640 1 -- 172.21.15.153:0/3770001098 shutdown_connections 2024-09-17T03:14:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.092+0000 7f7213e00640 1 -- 172.21.15.153:0/3770001098 wait complete. 2024-09-17T03:14:27.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.094+0000 7f7213e00640 1 Processor -- start 2024-09-17T03:14:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.094+0000 7f7213e00640 1 -- start start 2024-09-17T03:14:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214145cc0 0x7f7214072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72141f8920 0x7f72141f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f721406ff20 con 0x7f72140b2e60 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f721406fda0 con 0x7f72141f8920 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7213e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f72140700a0 con 0x7f7214145cc0 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.095+0000 7f7212a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40102/0 (socket says 172.21.15.153:40102) 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 -- 172.21.15.153:0/3857497187 learned_addr learned my addr 172.21.15.153:0/3857497187 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f720be00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214145cc0 0x7f7214072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7213400640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72141f8920 0x7f72141f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 -- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214145cc0 msgr2=0x7f7214072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214145cc0 0x7f7214072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 -- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72141f8920 msgr2=0x7f72141f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72141f8920 0x7f72141f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 -- 172.21.15.153:0/3857497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7214141c70 con 0x7f72140b2e60 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f7212a00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f720400c3a0 tx=0x7f720400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.096+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204017070 con 0x7f72140b2e60 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.097+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72040053c0 con 0x7f72140b2e60 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.097+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7214142f00 con 0x7f72140b2e60 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.097+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204003850 con 0x7f72140b2e60 2024-09-17T03:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.097+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72141421c0 con 0x7f72140b2e60 2024-09-17T03:14:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.098+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72140705c0 con 0x7f72140b2e60 2024-09-17T03:14:27.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.099+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f720401a070 con 0x7f72140b2e60 2024-09-17T03:14:27.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.100+0000 7f720aa00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 0x7f71f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.100+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6734+0+0 (secure 0 0 0) 0x7f720409a4a0 con 0x7f72140b2e60 2024-09-17T03:14:27.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.100+0000 7f720be00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 0x7f71f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.101+0000 7f720be00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 0x7f71f007b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7214152da0 tx=0x7f71fc00b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.104+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7204061e80 con 0x7f72140b2e60 2024-09-17T03:14:27.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.288+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72140cc5a0 con 0x7f72140b2e60 2024-09-17T03:14:27.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.841+0000 7f720aa00640 1 -- 172.21.15.153:0/3857497187 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f72040668b0 con 0x7f72140b2e60 2024-09-17T03:14:27.840 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:14:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 msgr2=0x7f71f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 0x7f71f007b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7214152da0 tx=0x7f71fc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 msgr2=0x7f72141429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f720400c3a0 tx=0x7f720400c860 comp rx=0 tx=0).stop 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 shutdown_connections 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f71f0078bc0 0x7f71f007b0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72141f8920 0x7f72141f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7214145cc0 0x7f7214072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 --2- 172.21.15.153:0/3857497187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72140b2e60 0x7f72141429c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 >> 172.21.15.153:0/3857497187 conn(0x7f72140d0460 msgr2=0x7f721415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 shutdown_connections 2024-09-17T03:14:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:27.844+0000 7f7213e00640 1 -- 172.21.15.153:0/3857497187 wait complete. 2024-09-17T03:14:27.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 -- 172.21.15.153:0/3710430152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e70005350 msgr2=0x7f2e7000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 --2- 172.21.15.153:0/3710430152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e70005350 0x7f2e7000b9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005fd0 tx=0x7f2e70005830 comp rx=0 tx=0).stop 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 -- 172.21.15.153:0/3710430152 shutdown_connections 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 --2- 172.21.15.153:0/3710430152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e70005350 0x7f2e7000b9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 -- 172.21.15.153:0/3710430152 >> 172.21.15.153:0/3710430152 conn(0x7f2e880ccac0 msgr2=0x7f2e880cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 -- 172.21.15.153:0/3710430152 shutdown_connections 2024-09-17T03:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.096+0000 7f2e90800640 1 -- 172.21.15.153:0/3710430152 wait complete. 2024-09-17T03:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.098+0000 7f2e90800640 1 Processor -- start 2024-09-17T03:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.099+0000 7f2e90800640 1 -- start start 2024-09-17T03:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e70005350 0x7f2e8815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e881f5e20 0x7f2e8806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8806e600 con 0x7f2e88070290 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8806e480 con 0x7f2e881f5e20 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e90800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8806e780 con 0x7f2e70005350 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e8e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40116/0 (socket says 172.21.15.153:40116) 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e8e800640 1 -- 172.21.15.153:0/3042688506 learned_addr learned my addr 172.21.15.153:0/3042688506 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e8d400640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e881f5e20 0x7f2e8806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.100+0000 7f2e8de00640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e70005350 0x7f2e8815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 -- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e70005350 msgr2=0x7f2e8815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e70005350 0x7f2e8815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 -- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e881f5e20 msgr2=0x7f2e8806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e881f5e20 0x7f2e8806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 -- 172.21.15.153:0/3042688506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e880706a0 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e8e800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e8402aec0 tx=0x7f2e840042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84009200 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e84041070 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e880c7890 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.101+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84009ad0 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.102+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e880c7e50 con 0x7f2e88070290 2024-09-17T03:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.103+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e880c75f0 con 0x7f2e88070290 2024-09-17T03:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.104+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e84046460 con 0x7f2e88070290 2024-09-17T03:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.105+0000 7f2e82000640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 0x7f2e6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.105+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6296+0+0 (secure 0 0 0) 0x7f2e840bc0a0 con 0x7f2e88070290 2024-09-17T03:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.105+0000 7f2e8de00640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 0x7f2e6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.106+0000 7f2e8de00640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 0x7f2e6c07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c006680 tx=0x7f2e7c006b70 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.109+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e880c75f0 con 0x7f2e88070290 2024-09-17T03:14:28.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.307+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2e8815c230 con 0x7f2e88070290 2024-09-17T03:14:28.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.843+0000 7f2e82000640 1 -- 172.21.15.153:0/3042688506 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f2e880706a0 con 0x7f2e88070290 2024-09-17T03:14:28.842 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-09-17T03:14:28.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 msgr2=0x7f2e6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 0x7f2e6c07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c006680 tx=0x7f2e7c006b70 comp rx=0 tx=0).stop 2024-09-17T03:14:28.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 msgr2=0x7f2e88074100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e8402aec0 tx=0x7f2e840042d0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 shutdown_connections 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2e6c078b90 0x7f2e6c07b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e88070290 0x7f2e88074100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e881f5e20 0x7f2e8806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 --2- 172.21.15.153:0/3042688506 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e70005350 0x7f2e8815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 >> 172.21.15.153:0/3042688506 conn(0x7f2e880ccac0 msgr2=0x7f2e880c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 shutdown_connections 2024-09-17T03:14:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:28.846+0000 7f2e90800640 1 -- 172.21.15.153:0/3042688506 wait complete. 2024-09-17T03:14:28.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-17T03:14:29.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 -- 172.21.15.153:0/990126421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d64145cc0 msgr2=0x7f9d640cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 --2- 172.21.15.153:0/990126421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d64145cc0 0x7f9d640cf030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009830 tx=0x7f9d5c02a510 comp rx=0 tx=0).stop 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 -- 172.21.15.153:0/990126421 shutdown_connections 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 --2- 172.21.15.153:0/990126421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d64145cc0 0x7f9d640cf030 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 --2- 172.21.15.153:0/990126421 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d64160670 0x7f9d640ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 -- 172.21.15.153:0/990126421 >> 172.21.15.153:0/990126421 conn(0x7f9d640d0460 msgr2=0x7f9d6406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 -- 172.21.15.153:0/990126421 shutdown_connections 2024-09-17T03:14:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.095+0000 7f9d68a00640 1 -- 172.21.15.153:0/990126421 wait complete. 2024-09-17T03:14:29.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.097+0000 7f9d68a00640 1 Processor -- start 2024-09-17T03:14:29.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.097+0000 7f9d68a00640 1 -- start start 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d640b2e60 0x7f9d640ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 0x7f9d64073d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6406ff10 con 0x7f9d64145cc0 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6406fd90 con 0x7f9d640b2e60 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d68a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9d64070090 con 0x7f9d640738f0 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d5aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d5aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40118/0 (socket says 172.21.15.153:40118) 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d5aa00640 1 -- 172.21.15.153:0/3811881415 learned_addr learned my addr 172.21.15.153:0/3811881415 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:29.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.099+0000 7f9d63400640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d640b2e60 0x7f9d640ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d63e00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 0x7f9d64073d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 -- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 msgr2=0x7f9d64073d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 0x7f9d64073d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 -- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d640b2e60 msgr2=0x7f9d640ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d640b2e60 0x7f9d640ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 -- 172.21.15.153:0/3811881415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d64074240 con 0x7f9d64145cc0 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d63e00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 0x7f9d64073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:29.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5aa00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00e9f0 tx=0x7f9d4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00cd80 con 0x7f9d64145cc0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c004020 con 0x7f9d64145cc0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d640add90 con 0x7f9d64145cc0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.100+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c004470 con 0x7f9d64145cc0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.101+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d640ae580 con 0x7f9d64145cc0 2024-09-17T03:14:29.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.102+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d640aef80 con 0x7f9d64145cc0 2024-09-17T03:14:29.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.103+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d4c0035f0 con 0x7f9d64145cc0 2024-09-17T03:14:29.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.104+0000 7f9d5be00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 0x7f9d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.104+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7f9d4c09b780 con 0x7f9d64145cc0 2024-09-17T03:14:29.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.104+0000 7f9d63400640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 0x7f9d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.105+0000 7f9d63400640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 0x7f9d4007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d54002200 tx=0x7f9d540019f0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:29.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.108+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d64074240 con 0x7f9d64145cc0 2024-09-17T03:14:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.291+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9d640ae030 con 0x7f9d64145cc0 2024-09-17T03:14:29.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.852+0000 7f9d5be00640 1 -- 172.21.15.153:0/3811881415 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f9d4c063aa0 con 0x7f9d64145cc0 2024-09-17T03:14:29.852 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data_ec' removed 2024-09-17T03:14:29.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 msgr2=0x7f9d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 0x7f9d4007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d54002200 tx=0x7f9d540019f0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 msgr2=0x7f9d641f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00e9f0 tx=0x7f9d4c00eeb0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 shutdown_connections 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9d40078b90 0x7f9d4007b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d640738f0 0x7f9d64073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d64145cc0 0x7f9d641f2730 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 --2- 172.21.15.153:0/3811881415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d640b2e60 0x7f9d640ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 >> 172.21.15.153:0/3811881415 conn(0x7f9d640d0460 msgr2=0x7f9d641e8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 shutdown_connections 2024-09-17T03:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:29.855+0000 7f9d68a00640 1 -- 172.21.15.153:0/3811881415 wait complete. 2024-09-17T03:14:29.885 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:14:29.885 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:14:29.885 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:14:29.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:29.886 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:14:29.886 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:14:29.886 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:14:29.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:29.886 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:14:29.886 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:14:29.887 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:14:29.887 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:29.887 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:14:29.887 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:14:29.887 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:14:29.887 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:29.909 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:14:29.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:14:29.911 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:14:29.911 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:14:29.912 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:14:29.912 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:14:29.913 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:14:29.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:14:29.954 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:14:29.955 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:29.957 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:14:29.958 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:29.958 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:14:29.959 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:29.961 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:14:29.961 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:29.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:14:30.161 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:14:30.162 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:14:30.162 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:14:30.162 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.207+0000 7f1c53000640 1 -- 172.21.15.153:0/3899787035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c0740f0 msgr2=0x7f1c4c074500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.207+0000 7f1c53000640 1 --2- 172.21.15.153:0/3899787035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c0740f0 0x7f1c4c074500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009830 tx=0x7f1c3802a510 comp rx=0 tx=0).stop 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 -- 172.21.15.153:0/3899787035 shutdown_connections 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 --2- 172.21.15.153:0/3899787035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c0740f0 0x7f1c4c074500 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 --2- 172.21.15.153:0/3899787035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c15c740 0x7f1c4c0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 -- 172.21.15.153:0/3899787035 >> 172.21.15.153:0/3899787035 conn(0x7f1c4c0735d0 msgr2=0x7f1c4c0739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:30.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 -- 172.21.15.153:0/3899787035 shutdown_connections 2024-09-17T03:14:30.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.208+0000 7f1c53000640 1 -- 172.21.15.153:0/3899787035 wait complete. 2024-09-17T03:14:30.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.210+0000 7f1c53000640 1 Processor -- start 2024-09-17T03:14:30.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.210+0000 7f1c53000640 1 -- start start 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c4c06ddf0 0x7f1c4c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c0740f0 0x7f1c4c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c0cfb10 con 0x7f1c4c15c740 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c0cf990 con 0x7f1c4c06ddf0 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c53000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c0cfc90 con 0x7f1c4c0740f0 2024-09-17T03:14:30.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40178/0 (socket says 172.21.15.153:40178) 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 -- 172.21.15.153:0/4259540624 learned_addr learned my addr 172.21.15.153:0/4259540624 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c4b400640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c0740f0 0x7f1c4c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c4be00640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c4c06ddf0 0x7f1c4c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 -- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c0740f0 msgr2=0x7f1c4c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c0740f0 0x7f1c4c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 -- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c4c06ddf0 msgr2=0x7f1c4c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c4c06ddf0 0x7f1c4c0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.212+0000 7f1c51000640 1 -- 172.21.15.153:0/4259540624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1593a0 con 0x7f1c4c15c740 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c51000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c760 tx=0x7f1c4400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44003b70 con 0x7f1c4c15c740 2024-09-17T03:14:30.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c44003d10 con 0x7f1c4c15c740 2024-09-17T03:14:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c0c85e0 con 0x7f1c4c15c740 2024-09-17T03:14:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c440052d0 con 0x7f1c4c15c740 2024-09-17T03:14:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.213+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1f6a80 con 0x7f1c4c15c740 2024-09-17T03:14:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.214+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c0d0140 con 0x7f1c4c15c740 2024-09-17T03:14:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.215+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c44005470 con 0x7f1c4c15c740 2024-09-17T03:14:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.216+0000 7f1c43e00640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 0x7f1c2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.217+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7f1c4409a790 con 0x7f1c4c15c740 2024-09-17T03:14:30.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.217+0000 7f1c4be00640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 0x7f1c2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.218+0000 7f1c4be00640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 0x7f1c2c07b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005fd0 tx=0x7f1c3c00a250 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:30.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.221+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c4c1593a0 con 0x7f1c4c15c740 2024-09-17T03:14:30.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.417+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1c4c0b15d0 con 0x7f1c4c15c740 2024-09-17T03:14:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.863+0000 7f1c43e00640 1 -- 172.21.15.153:0/4259540624 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7f1c44062780 con 0x7f1c4c15c740 2024-09-17T03:14:30.863 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2024-09-17T03:14:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 msgr2=0x7f1c2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 0x7f1c2c07b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005fd0 tx=0x7f1c3c00a250 comp rx=0 tx=0).stop 2024-09-17T03:14:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 msgr2=0x7f1c4c1f7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c760 tx=0x7f1c4400cb60 comp rx=0 tx=0).stop 2024-09-17T03:14:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 shutdown_connections 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1c2c078bc0 0x7f1c2c07b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c4c15c740 0x7f1c4c1f7280 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c4c0740f0 0x7f1c4c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 --2- 172.21.15.153:0/4259540624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c4c06ddf0 0x7f1c4c0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.866+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 >> 172.21.15.153:0/4259540624 conn(0x7f1c4c0735d0 msgr2=0x7f1c4c15bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.867+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 shutdown_connections 2024-09-17T03:14:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:30.867+0000 7f1c53000640 1 -- 172.21.15.153:0/4259540624 wait complete. 2024-09-17T03:14:30.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 -- 172.21.15.153:0/1753638319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 msgr2=0x7f9154004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 --2- 172.21.15.153:0/1753638319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f9154004c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f915c009d00 tx=0x7f9154005830 comp rx=0 tx=0).stop 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 -- 172.21.15.153:0/1753638319 shutdown_connections 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 --2- 172.21.15.153:0/1753638319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f9154004c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 -- 172.21.15.153:0/1753638319 >> 172.21.15.153:0/1753638319 conn(0x7f917006f940 msgr2=0x7f91700b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 -- 172.21.15.153:0/1753638319 shutdown_connections 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.122+0000 7f9175a00640 1 -- 172.21.15.153:0/1753638319 wait complete. 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.124+0000 7f9175a00640 1 Processor -- start 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.124+0000 7f9175a00640 1 -- start start 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9170152dc0 0x7f917015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 0x7f91701f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9170160dd0 con 0x7f9154004800 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9170160c50 con 0x7f917015ba50 2024-09-17T03:14:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9170160f50 con 0x7f9170152dc0 2024-09-17T03:14:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f916fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f916fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40202/0 (socket says 172.21.15.153:40202) 2024-09-17T03:14:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f916fe00640 1 -- 172.21.15.153:0/3763066100 learned_addr learned my addr 172.21.15.153:0/3763066100 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f9175000640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 0x7f91701f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.126+0000 7f916f400640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9170152dc0 0x7f917015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 -- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9170152dc0 msgr2=0x7f917015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9170152dc0 0x7f917015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 -- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 msgr2=0x7f91701f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 0x7f91701f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 -- 172.21.15.153:0/3763066100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91700d08f0 con 0x7f9154004800 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f9175000640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 0x7f91701f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f916fe00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9160001050 tx=0x7f9160001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160011640 con 0x7f9154004800 2024-09-17T03:14:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9160016020 con 0x7f9154004800 2024-09-17T03:14:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160011a80 con 0x7f9154004800 2024-09-17T03:14:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.127+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91701347f0 con 0x7f9154004800 2024-09-17T03:14:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.128+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9170134a90 con 0x7f9154004800 2024-09-17T03:14:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.129+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91700cd060 con 0x7f9154004800 2024-09-17T03:14:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.130+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9160011c20 con 0x7f9154004800 2024-09-17T03:14:31.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.131+0000 7f9167e00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 0x7f915007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.131+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f916009b6f0 con 0x7f9154004800 2024-09-17T03:14:31.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.131+0000 7f916f400640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 0x7f915007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.132+0000 7f916f400640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 0x7f915007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f915c035000 tx=0x7f915c0046c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.135+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9160020020 con 0x7f9154004800 2024-09-17T03:14:31.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.389+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f91700cc0e0 con 0x7f9154004800 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.390+0000 7f9167e00640 1 -- 172.21.15.153:0/3763066100 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f91701347f0 con 0x7f9154004800 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmLHZRBBAAGmAg1KpwGuZFL9Quv0LYcA==", 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.389 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmSI4xIBAAkjTGfzL4FBI0yMQYlitmnw==", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmR5dFEhAA9EF++beLMAzGgqO5hUf1dQ==", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2024-09-17T03:14:31.391 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmx/wZLhAACTfMeHYPEOv9h22zpC47MQ==", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCe8+hmUJHDHBAA6lJxR23sbaAInNreyCzTVw==", 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.392 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCh8+hmNzIiLhAA5aJqW/7GiFmCUqkF0uRMWA==", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCl8+hmjy5MARAA4WMewB9KHsaanVAyoxoVlQ==", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCo8+hm2n3MDRAAR4L8JPU3RpxMVx8Mj36Gcg==", 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.394 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCu8+hmxBHHDhAAKmnlrNMTbfXPOyZYfJcO5g==", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCx8+hm/R5RLBAA3nlpiixH68Vs3ElVKgYisA==", 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2024-09-17T03:14:31.396 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQC18+hmCLP0DBAA9BMFyyme36fx/dC2OYI+wg==", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQC48+hmaE0GHBAA2ngLlx3/ugZDkkn4KaNWWw==", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:14:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ==", 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.398 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmX/ojFBAAiMU/0oZB//5zuXTfSUXNJQ==", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmGy6SCRAAMo8JLvT0xfsNkU2Egh4HIg==", 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.399 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmLQG2HhAAQK4EusAMkZ3Vreg5HWt1tA==", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:14:31.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmabKoAxAAl8Hd8k/ANizp7sDkI2lQhg==", 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.401 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mds", 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hm0WAiJxAA0fM7CW0mX3ueNLmo5EW6zw==", 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hm6GoiJxAArJjG+Sbukbj54kojpSbi6Q==", 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-osd", 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hmVHMiJxAAY66smLndhMrIeLqZ7CZTUw==", 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hmtHsiJxAAkyiG7DXAKN3dh0+aNJX/QQ==", 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hmW4YiJxAALufviyRWY2HYYm+UGZTvBQ==", 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQDB8+hmqI4iJxAAfSfWAWxFDLlTCuzKYP5d5A==", 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmqFsANRAADCbozffXEEbgM48FQ9enKQ==", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmMSoAKhAAj3XmUlPA9YUsAJZpdvPhjQ==", 2024-09-17T03:14:31.405 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T03:14:31.406 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 msgr2=0x7f915007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 0x7f915007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f915c035000 tx=0x7f915c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 msgr2=0x7f91700d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9160001050 tx=0x7f9160001800 comp rx=0 tx=0).stop 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 shutdown_connections 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9150078b90 0x7f915007b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f917015ba50 0x7f91701f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9170152dc0 0x7f917015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 --2- 172.21.15.153:0/3763066100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9154004800 0x7f91700d03b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.392+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 >> 172.21.15.153:0/3763066100 conn(0x7f917006f940 msgr2=0x7f917015ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.393+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 shutdown_connections 2024-09-17T03:14:31.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.393+0000 7f9175a00640 1 -- 172.21.15.153:0/3763066100 wait complete. 2024-09-17T03:14:31.413 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T03:14:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 -- 172.21.15.153:0/550646788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8240cc530 msgr2=0x7ff82415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 --2- 172.21.15.153:0/550646788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8240cc530 0x7ff82415ead0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8241624c0 tx=0x7ff81402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 -- 172.21.15.153:0/550646788 shutdown_connections 2024-09-17T03:14:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 --2- 172.21.15.153:0/550646788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff82406e330 0x7ff8240ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 --2- 172.21.15.153:0/550646788 >> v2:172.21.15.164:3300/0 conn(0x7ff8240af5b0 0x7ff82406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 --2- 172.21.15.153:0/550646788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8240cc530 0x7ff82415ead0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 -- 172.21.15.153:0/550646788 >> 172.21.15.153:0/550646788 conn(0x7ff8240b1b90 msgr2=0x7ff8240b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 -- 172.21.15.153:0/550646788 shutdown_connections 2024-09-17T03:14:31.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.646+0000 7ff82a400640 1 -- 172.21.15.153:0/550646788 wait complete. 2024-09-17T03:14:31.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.648+0000 7ff82a400640 1 Processor -- start 2024-09-17T03:14:31.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.648+0000 7ff82a400640 1 -- start start 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8240af5b0 0x7ff824159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8240cc530 0x7ff82415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff8240cadb0 con 0x7ff82406e330 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff8240cac30 con 0x7ff8240cc530 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff82a400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff8240caf30 con 0x7ff8240af5b0 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff823400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff823400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40224/0 (socket says 172.21.15.153:40224) 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff823400640 1 -- 172.21.15.153:0/369806997 learned_addr learned my addr 172.21.15.153:0/369806997 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff823e00640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8240cc530 0x7ff82415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.650+0000 7ff822a00640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8240af5b0 0x7ff824159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 -- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8240af5b0 msgr2=0x7ff824159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8240af5b0 0x7ff824159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 -- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8240cc530 msgr2=0x7ff82415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8240cc530 0x7ff82415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 -- 172.21.15.153:0/369806997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82409da60 con 0x7ff82406e330 2024-09-17T03:14:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff823400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff814034040 tx=0x7ff8140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81403e030 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff814003ca0 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035040 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82409e1b0 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.651+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82409ff80 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.652+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8240cb450 con 0x7ff82406e330 2024-09-17T03:14:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.654+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff814041030 con 0x7ff82406e330 2024-09-17T03:14:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.655+0000 7ff81b400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 0x7ff80407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.655+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ff8140bb3e0 con 0x7ff82406e330 2024-09-17T03:14:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.656+0000 7ff822a00640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 0x7ff80407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.656+0000 7ff822a00640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 0x7ff80407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff82409f320 tx=0x7ff810005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.659+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff814083410 con 0x7ff82406e330 2024-09-17T03:14:31.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.927+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ff8240a1150 con 0x7ff82406e330 2024-09-17T03:14:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.930+0000 7ff81b400640 1 -- 172.21.15.153:0/369806997 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7ff814087e40 con 0x7ff82406e330 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 msgr2=0x7ff80407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 0x7ff80407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff82409f320 tx=0x7ff810005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 msgr2=0x7ff82409d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff814034040 tx=0x7ff8140038a0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 shutdown_connections 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff804078bc0 0x7ff80407b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8240cc530 0x7ff82415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff8240af5b0 0x7ff824159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 --2- 172.21.15.153:0/369806997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff82406e330 0x7ff82409d2a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 >> 172.21.15.153:0/369806997 conn(0x7ff8240b1b90 msgr2=0x7ff8240afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.932+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 shutdown_connections 2024-09-17T03:14:31.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:31.933+0000 7ff82a400640 1 -- 172.21.15.153:0/369806997 wait complete. 2024-09-17T03:14:31.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T03:14:32.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 -- 172.21.15.153:0/1998082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 msgr2=0x7fe2600cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 --2- 172.21.15.153:0/1998082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2600cf6d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe258005fd0 tx=0x7fe25802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 -- 172.21.15.153:0/1998082 shutdown_connections 2024-09-17T03:14:32.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 --2- 172.21.15.153:0/1998082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2600cf6d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 -- 172.21.15.153:0/1998082 >> 172.21.15.153:0/1998082 conn(0x7fe2600d05c0 msgr2=0x7fe26006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 -- 172.21.15.153:0/1998082 shutdown_connections 2024-09-17T03:14:32.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.184+0000 7fe266c00640 1 -- 172.21.15.153:0/1998082 wait complete. 2024-09-17T03:14:32.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.186+0000 7fe266c00640 1 Processor -- start 2024-09-17T03:14:32.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.187+0000 7fe266c00640 1 -- start start 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2600cc0e0 0x7fe2600c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2600c6be0 0x7fe2600cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2600b3e50 con 0x7fe2600702a0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2600b3cd0 con 0x7fe2600cc0e0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe2600b3fd0 con 0x7fe2600c6be0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe265800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe265800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40230/0 (socket says 172.21.15.153:40230) 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe265800640 1 -- 172.21.15.153:0/1273316505 learned_addr learned my addr 172.21.15.153:0/1273316505 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe264e00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2600cc0e0 0x7fe2600c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.188+0000 7fe266200640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2600c6be0 0x7fe2600cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 -- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2600c6be0 msgr2=0x7fe2600cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2600c6be0 0x7fe2600cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 -- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2600cc0e0 msgr2=0x7fe2600c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2600cc0e0 0x7fe2600c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 -- 172.21.15.153:0/1273316505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2601f69c0 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe265800640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c400 tx=0x7fe25400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254017070 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2540053c0 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254003850 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.189+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2601f6ca0 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.190+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2601f2b90 con 0x7fe2600702a0 2024-09-17T03:14:32.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.191+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2600cf6d0 con 0x7fe2600702a0 2024-09-17T03:14:32.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.192+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe25401a070 con 0x7fe2600702a0 2024-09-17T03:14:32.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.193+0000 7fe25d600640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 0x7fe24007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.193+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fe254099f70 con 0x7fe2600702a0 2024-09-17T03:14:32.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.193+0000 7fe264e00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 0x7fe24007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.194+0000 7fe264e00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 0x7fe24007b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe26015af40 tx=0x7fe24c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.197+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe254061e80 con 0x7fe2600702a0 2024-09-17T03:14:32.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.499+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fe260069230 con 0x7fe2600702a0 2024-09-17T03:14:32.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.502+0000 7fe25d600640 1 -- 172.21.15.153:0/1273316505 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fe2540668b0 con 0x7fe2600702a0 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 msgr2=0x7fe24007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 0x7fe24007b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe26015af40 tx=0x7fe24c009040 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 msgr2=0x7fe2601f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe25400c400 tx=0x7fe25400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 shutdown_connections 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe240078bc0 0x7fe24007b0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2600c6be0 0x7fe2600cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2600cc0e0 0x7fe2600c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 --2- 172.21.15.153:0/1273316505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2600702a0 0x7fe2601f6200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 >> 172.21.15.153:0/1273316505 conn(0x7fe2600d05c0 msgr2=0x7fe26015f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 shutdown_connections 2024-09-17T03:14:32.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.505+0000 7fe266c00640 1 -- 172.21.15.153:0/1273316505 wait complete. 2024-09-17T03:14:32.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T03:14:32.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 -- 172.21.15.153:0/3965441947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc0cef00 msgr2=0x7f88fc0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 --2- 172.21.15.153:0/3965441947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc0cef00 0x7f88fc0cf310 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f88f4005fd0 tx=0x7f88f402aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:32.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 -- 172.21.15.153:0/3965441947 shutdown_connections 2024-09-17T03:14:32.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 --2- 172.21.15.153:0/3965441947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc0cef00 0x7f88fc0cf310 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 --2- 172.21.15.153:0/3965441947 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc06ddf0 0x7f88fc06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 -- 172.21.15.153:0/3965441947 >> 172.21.15.153:0/3965441947 conn(0x7f88fc0b1b90 msgr2=0x7f88fc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 -- 172.21.15.153:0/3965441947 shutdown_connections 2024-09-17T03:14:32.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.750+0000 7f8902600640 1 -- 172.21.15.153:0/3965441947 wait complete. 2024-09-17T03:14:32.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.752+0000 7f8902600640 1 Processor -- start 2024-09-17T03:14:32.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.752+0000 7f8902600640 1 -- start start 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.753+0000 7f8902600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.753+0000 7f8902600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc0cef00 0x7f88fc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f8902600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc156a50 0x7f88fc15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f8902600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0cf850 con 0x7f88fc06ddf0 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f8902600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1610a0 con 0x7f88fc156a50 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f8902600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc0cf9d0 con 0x7f88fc0cef00 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40244/0 (socket says 172.21.15.153:40244) 2024-09-17T03:14:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 -- 172.21.15.153:0/4067014454 learned_addr learned my addr 172.21.15.153:0/4067014454 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88f2a00640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc0cef00 0x7f88fc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fbe00640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc156a50 0x7f88fc15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 -- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc0cef00 msgr2=0x7f88fc0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc0cef00 0x7f88fc0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 -- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc156a50 msgr2=0x7f88fc15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc156a50 0x7f88fc15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.754+0000 7f88fb400640 1 -- 172.21.15.153:0/4067014454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc1f8e40 con 0x7f88fc06ddf0 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f88fb400640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c730 tx=0x7f88ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0052d0 con 0x7f88fc06ddf0 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec005490 con 0x7f88fc06ddf0 2024-09-17T03:14:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1f9120 con 0x7f88fc06ddf0 2024-09-17T03:14:32.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00a8a0 con 0x7f88fc06ddf0 2024-09-17T03:14:32.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.755+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1f96e0 con 0x7f88fc06ddf0 2024-09-17T03:14:32.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.757+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc06e200 con 0x7f88fc06ddf0 2024-09-17T03:14:32.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.758+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88ec00aa40 con 0x7f88fc06ddf0 2024-09-17T03:14:32.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.758+0000 7f88f3e00640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 0x7f88d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.759+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f88ec09a520 con 0x7f88fc06ddf0 2024-09-17T03:14:32.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.759+0000 7f88f2a00640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 0x7f88d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.760+0000 7f88f2a00640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 0x7f88d807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88fc1ec810 tx=0x7f88e4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:32.763+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88fc06e740 con 0x7f88fc06ddf0 2024-09-17T03:14:33.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.021+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f88fc0b0900 con 0x7f88fc06ddf0 2024-09-17T03:14:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.024+0000 7f88f3e00640 1 -- 172.21.15.153:0/4067014454 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f88ec0624c0 con 0x7f88fc06ddf0 2024-09-17T03:14:33.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 msgr2=0x7f88d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 0x7f88d807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88fc1ec810 tx=0x7f88e4005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 msgr2=0x7f88fc0b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c730 tx=0x7f88ec00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 shutdown_connections 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f88d8078b90 0x7f88d807b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88fc156a50 0x7f88fc15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88fc0cef00 0x7f88fc0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 --2- 172.21.15.153:0/4067014454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88fc06ddf0 0x7f88fc0b3850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.027+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 >> 172.21.15.153:0/4067014454 conn(0x7f88fc0b1b90 msgr2=0x7f88fc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.028+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 shutdown_connections 2024-09-17T03:14:33.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.028+0000 7f8902600640 1 -- 172.21.15.153:0/4067014454 wait complete. 2024-09-17T03:14:33.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 -- 172.21.15.153:0/1730576582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f4073b10 msgr2=0x7f78f4073f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 --2- 172.21.15.153:0/1730576582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f4073b10 0x7f78f4073f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78f40cdf40 tx=0x7f78e002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 -- 172.21.15.153:0/1730576582 shutdown_connections 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 --2- 172.21.15.153:0/1730576582 >> v2:172.21.15.164:3300/0 conn(0x7f78f40b4a10 0x7f78f40b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 --2- 172.21.15.153:0/1730576582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f4073b10 0x7f78f4073f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 --2- 172.21.15.153:0/1730576582 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f40d00e0 0x7f78f40ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 -- 172.21.15.153:0/1730576582 >> 172.21.15.153:0/1730576582 conn(0x7f78f40d1190 msgr2=0x7f78f4073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 -- 172.21.15.153:0/1730576582 shutdown_connections 2024-09-17T03:14:33.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.269+0000 7f78fa800640 1 -- 172.21.15.153:0/1730576582 wait complete. 2024-09-17T03:14:33.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.272+0000 7f78fa800640 1 Processor -- start 2024-09-17T03:14:33.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.272+0000 7f78fa800640 1 -- start start 2024-09-17T03:14:33.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f4073b10 0x7f78f4148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f40d00e0 0x7f78f4070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78f40b56f0 con 0x7f78f40b4a10 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f78f40b5570 con 0x7f78f40d00e0 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78fa800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f78f40b5870 con 0x7f78f4073b10 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40268/0 (socket says 172.21.15.153:40268) 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.273+0000 7f78f8a00640 1 -- 172.21.15.153:0/626329512 learned_addr learned my addr 172.21.15.153:0/626329512 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f9400640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f4073b10 0x7f78f4148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f9e00640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f40d00e0 0x7f78f4070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 -- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f4073b10 msgr2=0x7f78f4148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f4073b10 0x7f78f4148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 -- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f40d00e0 msgr2=0x7f78f4070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f40d00e0 0x7f78f4070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 -- 172.21.15.153:0/626329512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f4149ad0 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.274+0000 7f78f8a00640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78e0034040 tx=0x7f78e0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.275+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e003e030 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.275+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78e0031780 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.275+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.275+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f4152550 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.275+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f4153840 con 0x7f78f40b4a10 2024-09-17T03:14:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.276+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f41522c0 con 0x7f78f40b4a10 2024-09-17T03:14:33.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.277+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78e0041030 con 0x7f78f40b4a10 2024-09-17T03:14:33.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.278+0000 7f78f1600640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 0x7f78d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.279+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f78e00bb300 con 0x7f78f40b4a10 2024-09-17T03:14:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.279+0000 7f78f9400640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 0x7f78d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.280+0000 7f78f9400640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 0x7f78d407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004630 tx=0x7f78e800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.283+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78e00832a0 con 0x7f78f40b4a10 2024-09-17T03:14:33.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.535+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f78f40b4e20 con 0x7f78f40b4a10 2024-09-17T03:14:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.538+0000 7f78f1600640 1 -- 172.21.15.153:0/626329512 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f78e00bb0c0 con 0x7f78f40b4a10 2024-09-17T03:14:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.540+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 msgr2=0x7f78d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.540+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 0x7f78d407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004630 tx=0x7f78e800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.540+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 msgr2=0x7f78f406fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.540+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78e0034040 tx=0x7f78e0005770 comp rx=0 tx=0).stop 2024-09-17T03:14:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 shutdown_connections 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f78d4078b90 0x7f78d407b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f40d00e0 0x7f78f4070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40b4a10 0x7f78f406fc50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 --2- 172.21.15.153:0/626329512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f4073b10 0x7f78f4148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 >> 172.21.15.153:0/626329512 conn(0x7f78f40d1190 msgr2=0x7f78f4153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 shutdown_connections 2024-09-17T03:14:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.541+0000 7f78fa800640 1 -- 172.21.15.153:0/626329512 wait complete. 2024-09-17T03:14:33.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T03:14:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 -- 172.21.15.153:0/2904472849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb015f6d0 msgr2=0x7f5eb015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 --2- 172.21.15.153:0/2904472849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb015f6d0 0x7f5eb015e3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0005fd0 tx=0x7f5ea002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 -- 172.21.15.153:0/2904472849 shutdown_connections 2024-09-17T03:14:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 --2- 172.21.15.153:0/2904472849 >> v2:172.21.15.164:3300/0 conn(0x7f5eb00cef00 0x7f5eb00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 --2- 172.21.15.153:0/2904472849 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb015f6d0 0x7f5eb015e3d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 -- 172.21.15.153:0/2904472849 >> 172.21.15.153:0/2904472849 conn(0x7f5eb00d41e0 msgr2=0x7f5eb00d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 -- 172.21.15.153:0/2904472849 shutdown_connections 2024-09-17T03:14:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.785+0000 7f5eafe00640 1 -- 172.21.15.153:0/2904472849 wait complete. 2024-09-17T03:14:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.787+0000 7f5eafe00640 1 Processor -- start 2024-09-17T03:14:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.787+0000 7f5eafe00640 1 -- start start 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb00cef00 0x7f5eb01f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5eb0162240 0x7f5eb01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb015eb00 con 0x7f5eb015f6d0 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb006dd20 con 0x7f5eb0162240 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eafe00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb00d32a0 con 0x7f5eb00cef00 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eaea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb00cef00 0x7f5eb01f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43778/0 (socket says 172.21.15.153:43778) 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 -- 172.21.15.153:0/1210563490 learned_addr learned my addr 172.21.15.153:0/1210563490 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eaf400640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5eb0162240 0x7f5eb01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 -- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb00cef00 msgr2=0x7f5eb01f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb00cef00 0x7f5eb01f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 -- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5eb0162240 msgr2=0x7f5eb01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5eb0162240 0x7f5eb01553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.789+0000 7f5eae000640 1 -- 172.21.15.153:0/1210563490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb00cbf20 con 0x7f5eb015f6d0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5eae000640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ea20 tx=0x7f5e9c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00cd50 con 0x7f5eb015f6d0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e9c004020 con 0x7f5eb015f6d0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb00cc200 con 0x7f5eb015f6d0 2024-09-17T03:14:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004450 con 0x7f5eb015f6d0 2024-09-17T03:14:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.790+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb00cc7c0 con 0x7f5eb015f6d0 2024-09-17T03:14:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.791+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb00cf310 con 0x7f5eb015f6d0 2024-09-17T03:14:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.792+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e9c0035f0 con 0x7f5eb015f6d0 2024-09-17T03:14:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.793+0000 7f5ea6a00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 0x7f5e9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.793+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f5e9c09b490 con 0x7f5eb015f6d0 2024-09-17T03:14:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.794+0000 7f5eaea00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 0x7f5e9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.794+0000 7f5eaea00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 0x7f5e9007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0033000 tx=0x7f5ea0004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:33.798+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e9c0633b0 con 0x7f5eb015f6d0 2024-09-17T03:14:34.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.050+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f5eb0161c90 con 0x7f5eb015f6d0 2024-09-17T03:14:34.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.053+0000 7f5ea6a00640 1 -- 172.21.15.153:0/1210563490 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f5e9c067de0 con 0x7f5eb015f6d0 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 msgr2=0x7f5e9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 0x7f5e9007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0033000 tx=0x7f5ea0004730 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 msgr2=0x7f5eb00cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00ea20 tx=0x7f5e9c00eee0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 shutdown_connections 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5e90078b90 0x7f5e9007b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5eb0162240 0x7f5eb01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb015f6d0 0x7f5eb00cb260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 --2- 172.21.15.153:0/1210563490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5eb00cef00 0x7f5eb01f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 >> 172.21.15.153:0/1210563490 conn(0x7f5eb00d41e0 msgr2=0x7f5eb00b9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 shutdown_connections 2024-09-17T03:14:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.056+0000 7f5eafe00640 1 -- 172.21.15.153:0/1210563490 wait complete. 2024-09-17T03:14:34.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T03:14:34.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 -- 172.21.15.153:0/570828835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78071160 msgr2=0x7fed78071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 --2- 172.21.15.153:0/570828835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78071160 0x7fed78071570 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed70005fd0 tx=0x7fed7002aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 -- 172.21.15.153:0/570828835 shutdown_connections 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 --2- 172.21.15.153:0/570828835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78071160 0x7fed78071570 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 --2- 172.21.15.153:0/570828835 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 0x7fed780cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 -- 172.21.15.153:0/570828835 >> 172.21.15.153:0/570828835 conn(0x7fed7806fc80 msgr2=0x7fed78070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 -- 172.21.15.153:0/570828835 shutdown_connections 2024-09-17T03:14:34.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.301+0000 7fed7e200640 1 -- 172.21.15.153:0/570828835 wait complete. 2024-09-17T03:14:34.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.303+0000 7fed7e200640 1 Processor -- start 2024-09-17T03:14:34.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.303+0000 7fed7e200640 1 -- start start 2024-09-17T03:14:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78071160 0x7fed7813f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 0x7fed781f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed7806d170 con 0x7fed78145bf0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed7806cff0 con 0x7fed78071160 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7e200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fed7806d2f0 con 0x7fed7815d5e0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed6fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed6fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43788/0 (socket says 172.21.15.153:43788) 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed6fe00640 1 -- 172.21.15.153:0/2742722775 learned_addr learned my addr 172.21.15.153:0/2742722775 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7d800640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 0x7fed781f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.305+0000 7fed7ce00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78071160 0x7fed7813f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 -- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 msgr2=0x7fed781f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 0x7fed781f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 -- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78071160 msgr2=0x7fed7813f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78071160 0x7fed7813f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 -- 172.21.15.153:0/2742722775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7813c4a0 con 0x7fed78145bf0 2024-09-17T03:14:34.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed6fe00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c370 tx=0x7fed6000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60017070 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed600053c0 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60003850 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7813fa20 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.306+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7813bee0 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.307+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed78071570 con 0x7fed78145bf0 2024-09-17T03:14:34.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.309+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed6001a070 con 0x7fed78145bf0 2024-09-17T03:14:34.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.310+0000 7fed75600640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 0x7fed5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.310+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fed60099ea0 con 0x7fed78145bf0 2024-09-17T03:14:34.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.311+0000 7fed7ce00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 0x7fed5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.311+0000 7fed7ce00640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 0x7fed5407b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed6800bb50 tx=0x7fed6800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.315+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed78071ab0 con 0x7fed78145bf0 2024-09-17T03:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.566+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fed780b08a0 con 0x7fed78145bf0 2024-09-17T03:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.569+0000 7fed75600640 1 -- 172.21.15.153:0/2742722775 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fed60061e40 con 0x7fed78145bf0 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 msgr2=0x7fed5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 0x7fed5407b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed6800bb50 tx=0x7fed6800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 msgr2=0x7fed781f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c370 tx=0x7fed6000c830 comp rx=0 tx=0).stop 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 shutdown_connections 2024-09-17T03:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed54078bc0 0x7fed5407b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed7815d5e0 0x7fed781f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed78145bf0 0x7fed781f6940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 --2- 172.21.15.153:0/2742722775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78071160 0x7fed7813f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 >> 172.21.15.153:0/2742722775 conn(0x7fed7806fc80 msgr2=0x7fed780cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 shutdown_connections 2024-09-17T03:14:34.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.573+0000 7fed7e200640 1 -- 172.21.15.153:0/2742722775 wait complete. 2024-09-17T03:14:34.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:14:34.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.812+0000 7f2dec000640 1 -- 172.21.15.153:0/673769335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 msgr2=0x7f2de40cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.812+0000 7f2dec000640 1 --2- 172.21.15.153:0/673769335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40cdb90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2de4071fa0 tx=0x7f2ddc02aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:34.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 -- 172.21.15.153:0/673769335 shutdown_connections 2024-09-17T03:14:34.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 --2- 172.21.15.153:0/673769335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40cdb90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 --2- 172.21.15.153:0/673769335 >> v2:172.21.15.164:3300/0 conn(0x7f2de4070030 0x7f2de406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 -- 172.21.15.153:0/673769335 >> 172.21.15.153:0/673769335 conn(0x7f2de40cca40 msgr2=0x7f2de40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 -- 172.21.15.153:0/673769335 shutdown_connections 2024-09-17T03:14:34.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.813+0000 7f2dec000640 1 -- 172.21.15.153:0/673769335 wait complete. 2024-09-17T03:14:34.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.815+0000 7f2dec000640 1 Processor -- start 2024-09-17T03:14:34.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.815+0000 7f2dec000640 1 -- start start 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2de4070030 0x7f2de409ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2de4074d90 0x7f2de409bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4071000 con 0x7f2de406e330 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4070e80 con 0x7f2de4070030 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.816+0000 7f2dec000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40ce0d0 con 0x7f2de4074d90 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43810/0 (socket says 172.21.15.153:43810) 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 -- 172.21.15.153:0/1363521316 learned_addr learned my addr 172.21.15.153:0/1363521316 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:34.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de8c00640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2de4070030 0x7f2de409ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2dea000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2de4074d90 0x7f2de409bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 -- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2de4074d90 msgr2=0x7f2de409bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2de4074d90 0x7f2de409bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 -- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2de4070030 msgr2=0x7f2de409ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2de4070030 0x7f2de409ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 -- 172.21.15.153:0/1363521316 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de4152930 con 0x7f2de406e330 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.817+0000 7f2de9600640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800b3f0 tx=0x7f2dd800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.818+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8015020 con 0x7f2de406e330 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.818+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dd8011920 con 0x7f2de406e330 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.818+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8011d70 con 0x7f2de406e330 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.818+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de409e590 con 0x7f2de406e330 2024-09-17T03:14:34.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.818+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de409c7b0 con 0x7f2de406e330 2024-09-17T03:14:34.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.819+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de409e380 con 0x7f2de406e330 2024-09-17T03:14:34.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.820+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2dd8018020 con 0x7f2de406e330 2024-09-17T03:14:34.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.821+0000 7f2de1600640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.821+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2dd809a7c0 con 0x7f2de406e330 2024-09-17T03:14:34.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.821+0000 7f2de8c00640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.822+0000 7f2de8c00640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 0x7f2dc407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0005fd0 tx=0x7f2dd0005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:34.825+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2dd801f030 con 0x7f2de406e330 2024-09-17T03:14:35.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.013+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2de40ce5f0 con 0x7f2de406e330 2024-09-17T03:14:35.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.013+0000 7f2de1600640 1 -- 172.21.15.153:0/1363521316 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7f2dd8062e40 con 0x7f2de406e330 2024-09-17T03:14:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:35.012 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-09-17T03:14:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:14:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-09-17T03:14:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-09-17T03:14:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:14:35.013 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 msgr2=0x7f2dc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 0x7f2dc407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0005fd0 tx=0x7f2dd0005850 comp rx=0 tx=0).stop 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 msgr2=0x7f2de40c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800b3f0 tx=0x7f2dd800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 shutdown_connections 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2de4074d90 0x7f2de409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2de4070030 0x7f2de409ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 --2- 172.21.15.153:0/1363521316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2de406e330 0x7f2de40c2db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 >> 172.21.15.153:0/1363521316 conn(0x7f2de40cca40 msgr2=0x7f2de40cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 shutdown_connections 2024-09-17T03:14:35.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.016+0000 7f2dec000640 1 -- 172.21.15.153:0/1363521316 wait complete. 2024-09-17T03:14:35.037 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:14:35.037 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 -- 172.21.15.153:0/2511447965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c145cc0 msgr2=0x7f811c1604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 --2- 172.21.15.153:0/2511447965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c145cc0 0x7f811c1604a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8104005fd0 tx=0x7f810402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 -- 172.21.15.153:0/2511447965 shutdown_connections 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 --2- 172.21.15.153:0/2511447965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c145cc0 0x7f811c1604a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 --2- 172.21.15.153:0/2511447965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0b2e60 0x7f811c15ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 -- 172.21.15.153:0/2511447965 >> 172.21.15.153:0/2511447965 conn(0x7f811c0d0460 msgr2=0x7f811c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 -- 172.21.15.153:0/2511447965 shutdown_connections 2024-09-17T03:14:35.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.261+0000 7f811be00640 1 -- 172.21.15.153:0/2511447965 wait complete. 2024-09-17T03:14:35.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.263+0000 7f811be00640 1 Processor -- start 2024-09-17T03:14:35.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.263+0000 7f811be00640 1 -- start start 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c0b2e60 0x7f811c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0ceaf0 0x7f811c1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f811c06ff10 con 0x7f811c145cc0 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f811c06fd90 con 0x7f811c0b2e60 2024-09-17T03:14:35.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f811c070090 con 0x7f811c0ceaf0 2024-09-17T03:14:35.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43824/0 (socket says 172.21.15.153:43824) 2024-09-17T03:14:35.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811b400640 1 -- 172.21.15.153:0/3227817313 learned_addr learned my addr 172.21.15.153:0/3227817313 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:35.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f811aa00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c0b2e60 0x7f811c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.265+0000 7f8112000640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0ceaf0 0x7f811c1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 -- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0ceaf0 msgr2=0x7f811c1f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0ceaf0 0x7f811c1f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 -- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c0b2e60 msgr2=0x7f811c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c0b2e60 0x7f811c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 -- 172.21.15.153:0/3227817313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c1e6050 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811b400640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f811400c3f0 tx=0x7f811400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114017070 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81140053c0 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1e6330 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114003850 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.266+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1e68f0 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.267+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c0705b0 con 0x7f811c145cc0 2024-09-17T03:14:35.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.269+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f811401a070 con 0x7f811c145cc0 2024-09-17T03:14:35.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.270+0000 7f8113400640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 0x7f80f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.270+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f8114099ee0 con 0x7f811c145cc0 2024-09-17T03:14:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.271+0000 7f811aa00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 0x7f80f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.271+0000 7f811aa00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 0x7f80f807b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f810c005fd0 tx=0x7f810c009500 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.275+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8114061df0 con 0x7f811c145cc0 2024-09-17T03:14:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.457+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f811c0b45d0 con 0x7f811c145cc0 2024-09-17T03:14:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.882+0000 7f8113400640 1 -- 172.21.15.153:0/3227817313 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7f8114066820 con 0x7f811c145cc0 2024-09-17T03:14:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.884+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 msgr2=0x7f80f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.884+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 0x7f80f807b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f810c005fd0 tx=0x7f810c009500 comp rx=0 tx=0).stop 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.884+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 msgr2=0x7f811c1f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f811400c3f0 tx=0x7f811400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 shutdown_connections 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f80f8078b90 0x7f80f807b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c145cc0 0x7f811c1f6d50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f811c0ceaf0 0x7f811c1f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 --2- 172.21.15.153:0/3227817313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f811c0b2e60 0x7f811c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 >> 172.21.15.153:0/3227817313 conn(0x7f811c0d0460 msgr2=0x7f811c15e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 shutdown_connections 2024-09-17T03:14:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:35.885+0000 7f811be00640 1 -- 172.21.15.153:0/3227817313 wait complete. 2024-09-17T03:14:35.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.142+0000 7f6030a00640 1 -- 172.21.15.153:0/2620595962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 msgr2=0x7f602c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.142+0000 7f6030a00640 1 --2- 172.21.15.153:0/2620595962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c06ddf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f602c15d980 tx=0x7f601802a560 comp rx=0 tx=0).stop 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 -- 172.21.15.153:0/2620595962 shutdown_connections 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 --2- 172.21.15.153:0/2620595962 >> v2:172.21.15.164:3300/0 conn(0x7f602c06e330 0x7f602c06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 --2- 172.21.15.153:0/2620595962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c06ddf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 -- 172.21.15.153:0/2620595962 >> 172.21.15.153:0/2620595962 conn(0x7f602c0cca40 msgr2=0x7f602c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 -- 172.21.15.153:0/2620595962 shutdown_connections 2024-09-17T03:14:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.143+0000 7f6030a00640 1 -- 172.21.15.153:0/2620595962 wait complete. 2024-09-17T03:14:36.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.145+0000 7f6030a00640 1 Processor -- start 2024-09-17T03:14:36.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.145+0000 7f6030a00640 1 -- start start 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.146+0000 7f6030a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 0x7f602c1f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.146+0000 7f6030a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6030a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c074cb0 0x7f602c15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6030a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f602c06f4a0 con 0x7f602c073dd0 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6030a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f602c06f320 con 0x7f602c074cb0 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6030a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f602c06f620 con 0x7f602c06e330 2024-09-17T03:14:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43836/0 (socket says 172.21.15.153:43836) 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 -- 172.21.15.153:0/2269283410 learned_addr learned my addr 172.21.15.153:0/2269283410 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f602a800640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c074cb0 0x7f602c15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029e00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 0x7f602c1f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 -- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 msgr2=0x7f602c1f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 0x7f602c1f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 -- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c074cb0 msgr2=0x7f602c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c074cb0 0x7f602c15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029400640 1 -- 172.21.15.153:0/2269283410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c0b3f00 con 0x7f602c073dd0 2024-09-17T03:14:36.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.147+0000 7f6029e00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 0x7f602c1f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6029400640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6018034040 tx=0x7f6018003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601803e030 con 0x7f602c073dd0 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6018003e00 con 0x7f602c073dd0 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c0b41e0 con 0x7f602c073dd0 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018035040 con 0x7f602c073dd0 2024-09-17T03:14:36.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.148+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c0b47a0 con 0x7f602c073dd0 2024-09-17T03:14:36.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.149+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c06fbc0 con 0x7f602c073dd0 2024-09-17T03:14:36.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.151+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6018041030 con 0x7f602c073dd0 2024-09-17T03:14:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.152+0000 7f6022000640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 0x7f600c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.152+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f60180bb550 con 0x7f602c073dd0 2024-09-17T03:14:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.153+0000 7f6029e00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 0x7f600c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.153+0000 7f6029e00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 0x7f600c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f602c15a730 tx=0x7f601c008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.157+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f602c06e740 con 0x7f602c073dd0 2024-09-17T03:14:36.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.344+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f602c15ec20 con 0x7f602c073dd0 2024-09-17T03:14:36.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.890+0000 7f6022000640 1 -- 172.21.15.153:0/2269283410 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f60180839d0 con 0x7f602c073dd0 2024-09-17T03:14:36.890 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-09-17T03:14:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 msgr2=0x7f600c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 0x7f600c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f602c15a730 tx=0x7f601c008040 comp rx=0 tx=0).stop 2024-09-17T03:14:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 msgr2=0x7f602c09bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6018034040 tx=0x7f6018003910 comp rx=0 tx=0).stop 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 shutdown_connections 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f600c078b90 0x7f600c07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f602c074cb0 0x7f602c15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f602c073dd0 0x7f602c09bf30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 --2- 172.21.15.153:0/2269283410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f602c06e330 0x7f602c1f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 >> 172.21.15.153:0/2269283410 conn(0x7f602c0cca40 msgr2=0x7f602c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 shutdown_connections 2024-09-17T03:14:36.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:36.893+0000 7f6030a00640 1 -- 172.21.15.153:0/2269283410 wait complete. 2024-09-17T03:14:36.933 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:14:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 -- 172.21.15.153:0/1765896393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b80ccfc0 msgr2=0x7f71b80cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 --2- 172.21.15.153:0/1765896393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b80ccfc0 0x7f71b80cddc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f71b8074f00 tx=0x7f71b002aa10 comp rx=0 tx=0).stop 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 -- 172.21.15.153:0/1765896393 shutdown_connections 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 --2- 172.21.15.153:0/1765896393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b80ccfc0 0x7f71b80cddc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 --2- 172.21.15.153:0/1765896393 >> v2:172.21.15.164:3300/0 conn(0x7f71b806e370 0x7f71b80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 -- 172.21.15.153:0/1765896393 >> 172.21.15.153:0/1765896393 conn(0x7f71b806f920 msgr2=0x7f71b80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 -- 172.21.15.153:0/1765896393 shutdown_connections 2024-09-17T03:14:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.160+0000 7f71bdc00640 1 -- 172.21.15.153:0/1765896393 wait complete. 2024-09-17T03:14:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.162+0000 7f71bdc00640 1 Processor -- start 2024-09-17T03:14:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.163+0000 7f71bdc00640 1 -- start start 2024-09-17T03:14:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71b806e370 0x7f71b814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71b8156c60 0x7f71b8159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71b806d560 con 0x7f71b814d660 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f71b806d3e0 con 0x7f71b8156c60 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bdc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f71b806d6e0 con 0x7f71b806e370 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bd200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bd200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43854/0 (socket says 172.21.15.153:43854) 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.164+0000 7f71bd200640 1 -- 172.21.15.153:0/3091858474 learned_addr learned my addr 172.21.15.153:0/3091858474 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71b7e00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71b806e370 0x7f71b814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71af400640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71b8156c60 0x7f71b8159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 -- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71b806e370 msgr2=0x7f71b814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71b806e370 0x7f71b814c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 -- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71b8156c60 msgr2=0x7f71b8159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71b8156c60 0x7f71b8159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 -- 172.21.15.153:0/3091858474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b81f6b20 con 0x7f71b814d660 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.165+0000 7f71bd200640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f71b002afd0 tx=0x7f71b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.166+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0033050 con 0x7f71b814d660 2024-09-17T03:14:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.166+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71b00042d0 con 0x7f71b814d660 2024-09-17T03:14:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.166+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b81f6e00 con 0x7f71b814d660 2024-09-17T03:14:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.166+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0004720 con 0x7f71b814d660 2024-09-17T03:14:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.166+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b81f3040 con 0x7f71b814d660 2024-09-17T03:14:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.167+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b81f0880 con 0x7f71b814d660 2024-09-17T03:14:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.168+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71b0036070 con 0x7f71b814d660 2024-09-17T03:14:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.169+0000 7f71b4c00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 0x7f719407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.169+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f71b00bbfd0 con 0x7f71b814d660 2024-09-17T03:14:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.170+0000 7f71b7e00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 0x7f719407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.170+0000 7f71b7e00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 0x7f719407b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71a8004630 tx=0x7f71a800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.174+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71b0083bf0 con 0x7f71b814d660 2024-09-17T03:14:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.394+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f71b81f68b0 con 0x7f71b814d660 2024-09-17T03:14:37.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.893+0000 7f71b4c00640 1 -- 172.21.15.153:0/3091858474 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f71b0088620 con 0x7f71b814d660 2024-09-17T03:14:37.892 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 5 and data pool 6 2024-09-17T03:14:37.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.897+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 msgr2=0x7f719407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.897+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 0x7f719407b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71a8004630 tx=0x7f71a800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.897+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 msgr2=0x7f71b81f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.897+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f71b002afd0 tx=0x7f71b0003f10 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.897+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 shutdown_connections 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7194078b90 0x7f719407b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b814d660 0x7f71b81f3560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71b8156c60 0x7f71b8159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 --2- 172.21.15.153:0/3091858474 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71b806e370 0x7f71b814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 >> 172.21.15.153:0/3091858474 conn(0x7f71b806f920 msgr2=0x7f71b80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:37.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.898+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 shutdown_connections 2024-09-17T03:14:37.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:37.899+0000 7f71bdc00640 1 -- 172.21.15.153:0/3091858474 wait complete. 2024-09-17T03:14:37.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 -- 172.21.15.153:0/737280302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415b9f0 msgr2=0x7fd0d40cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 --2- 172.21.15.153:0/737280302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415b9f0 0x7fd0d40cf930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009830 tx=0x7fd0c802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 -- 172.21.15.153:0/737280302 shutdown_connections 2024-09-17T03:14:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 --2- 172.21.15.153:0/737280302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415b9f0 0x7fd0d40cf930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 -- 172.21.15.153:0/737280302 >> 172.21.15.153:0/737280302 conn(0x7fd0d40cca40 msgr2=0x7fd0d40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 -- 172.21.15.153:0/737280302 shutdown_connections 2024-09-17T03:14:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.175+0000 7fd0db600640 1 -- 172.21.15.153:0/737280302 wait complete. 2024-09-17T03:14:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.177+0000 7fd0db600640 1 Processor -- start 2024-09-17T03:14:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.177+0000 7fd0db600640 1 -- start start 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0d415b9f0 0x7fd0d40c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 0x7fd0d41e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d406e680 con 0x7fd0d40cefa0 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d406e500 con 0x7fd0d415f5a0 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0db600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d415f9b0 con 0x7fd0d415b9f0 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43858/0 (socket says 172.21.15.153:43858) 2024-09-17T03:14:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 -- 172.21.15.153:0/3354985556 learned_addr learned my addr 172.21.15.153:0/3354985556 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 -- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0d415b9f0 msgr2=0x7fd0d40c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0d415b9f0 0x7fd0d40c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 -- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 msgr2=0x7fd0d41e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d9600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 0x7fd0d41e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.179+0000 7fd0d8c00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 0x7fd0d41e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d8c00640 1 -- 172.21.15.153:0/3354985556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d40b3610 con 0x7fd0d40cefa0 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d9600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 0x7fd0d41e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d8c00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0c802aba0 tx=0x7fd0c8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8031b50 con 0x7fd0d40cefa0 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c8031de0 con 0x7fd0d40cefa0 2024-09-17T03:14:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d40c31d0 con 0x7fd0d40cefa0 2024-09-17T03:14:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8005280 con 0x7fd0d40cefa0 2024-09-17T03:14:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.180+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d40b3b60 con 0x7fd0d40cefa0 2024-09-17T03:14:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.181+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d40cf930 con 0x7fd0d40cefa0 2024-09-17T03:14:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.183+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0c8005420 con 0x7fd0d40cefa0 2024-09-17T03:14:38.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.184+0000 7fd0d0c00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 0x7fd0b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.184+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd0c80bbff0 con 0x7fd0d40cefa0 2024-09-17T03:14:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.184+0000 7fd0d3e00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 0x7fd0b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.185+0000 7fd0d3e00640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 0x7fd0b407b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40af990 tx=0x7fd0c0007970 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.189+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd0c803f030 con 0x7fd0d40cefa0 2024-09-17T03:14:38.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.372+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0d4159970 con 0x7fd0d40cefa0 2024-09-17T03:14:38.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.373+0000 7fd0d0c00640 1 -- 172.21.15.153:0/3354985556 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17051 (secure 0 0 0) 0x7fd0c80842b0 con 0x7fd0d40cefa0 2024-09-17T03:14:38.372 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:38.372 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:37.396433+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:35.469865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:36.356142+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 msgr2=0x7fd0b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 0x7fd0b407b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40af990 tx=0x7fd0c0007970 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 msgr2=0x7fd0d40b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0c802aba0 tx=0x7fd0c8033ba0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 shutdown_connections 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd0b4078bc0 0x7fd0b407b0d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0d415f5a0 0x7fd0d41e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0d415b9f0 0x7fd0d40c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 --2- 172.21.15.153:0/3354985556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d40cefa0 0x7fd0d40b5990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 >> 172.21.15.153:0/3354985556 conn(0x7fd0d40cca40 msgr2=0x7fd0d406f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 shutdown_connections 2024-09-17T03:14:38.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.376+0000 7fd0db600640 1 -- 172.21.15.153:0/3354985556 wait complete. 2024-09-17T03:14:38.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 -- 172.21.15.153:0/3568081052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6415dfe0 msgr2=0x7f4d64160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 --2- 172.21.15.153:0/3568081052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6415dfe0 0x7f4d64160a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005fd0 tx=0x7f4d5402a540 comp rx=0 tx=0).stop 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 -- 172.21.15.153:0/3568081052 shutdown_connections 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 --2- 172.21.15.153:0/3568081052 >> v2:172.21.15.164:3300/0 conn(0x7f4d640ccfe0 0x7f4d6406e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 --2- 172.21.15.153:0/3568081052 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6415dfe0 0x7f4d64160a40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 -- 172.21.15.153:0/3568081052 >> 172.21.15.153:0/3568081052 conn(0x7f4d6406f940 msgr2=0x7f4d640b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.618+0000 7f4d63e00640 1 -- 172.21.15.153:0/3568081052 shutdown_connections 2024-09-17T03:14:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.619+0000 7f4d63e00640 1 -- 172.21.15.153:0/3568081052 wait complete. 2024-09-17T03:14:38.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.621+0000 7f4d63e00640 1 Processor -- start 2024-09-17T03:14:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.621+0000 7f4d63e00640 1 -- start start 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 0x7f4d6413da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d64143df0 0x7f4d640aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d640b4c50 con 0x7f4d6415dfe0 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4d640b4ad0 con 0x7f4d64143df0 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d63e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4d640b4dd0 con 0x7f4d6406e160 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.622+0000 7f4d5a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43872/0 (socket says 172.21.15.153:43872) 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 -- 172.21.15.153:0/1915623752 learned_addr learned my addr 172.21.15.153:0/1915623752 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d62a00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 0x7f4d6413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d63400640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d64143df0 0x7f4d640aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 -- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 msgr2=0x7f4d6413da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 0x7f4d6413da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 -- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d64143df0 msgr2=0x7f4d640aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d64143df0 0x7f4d640aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 -- 172.21.15.153:0/1915623752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6415b750 con 0x7f4d6415dfe0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d62a00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 0x7f4d6413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5a000640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c690 tx=0x7f4d4c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.623+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c016020 con 0x7f4d6415dfe0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.624+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d4c003970 con 0x7f4d6415dfe0 2024-09-17T03:14:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.624+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c006e60 con 0x7f4d6415dfe0 2024-09-17T03:14:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.624+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6413f2b0 con 0x7f4d6415dfe0 2024-09-17T03:14:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.624+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d64144850 con 0x7f4d6415dfe0 2024-09-17T03:14:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.625+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d641442e0 con 0x7f4d6415dfe0 2024-09-17T03:14:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.626+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d4c0050d0 con 0x7f4d6415dfe0 2024-09-17T03:14:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.628+0000 7f4d5b400640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.628+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4d4c09ac60 con 0x7f4d6415dfe0 2024-09-17T03:14:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.628+0000 7f4d62a00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.629+0000 7f4d62a00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 0x7f4d4007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d54033000 tx=0x7f4d54004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.632+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d4c020020 con 0x7f4d6415dfe0 2024-09-17T03:14:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.816+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d640b52f0 con 0x7f4d6415dfe0 2024-09-17T03:14:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.818+0000 7f4d5b400640 1 -- 172.21.15.153:0/1915623752 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17051 (secure 0 0 0) 0x7f4d4c062830 con 0x7f4d6415dfe0 2024-09-17T03:14:38.817 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:38.817 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:37.396433+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:35.469865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:36.356142+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:38.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 msgr2=0x7f4d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 0x7f4d4007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d54033000 tx=0x7f4d54004730 comp rx=0 tx=0).stop 2024-09-17T03:14:38.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 msgr2=0x7f4d641438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00c690 tx=0x7f4d4c00cb50 comp rx=0 tx=0).stop 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 shutdown_connections 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d64143df0 0x7f4d640aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6415dfe0 0x7f4d641438b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 --2- 172.21.15.153:0/1915623752 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4d6406e160 0x7f4d6413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 >> 172.21.15.153:0/1915623752 conn(0x7f4d6406f940 msgr2=0x7f4d640b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 shutdown_connections 2024-09-17T03:14:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:38.820+0000 7f4d63e00640 1 -- 172.21.15.153:0/1915623752 wait complete. 2024-09-17T03:14:38.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:14:39.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 -- 172.21.15.153:0/191319907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce4074b60 msgr2=0x7f0ce406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/191319907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce4074b60 0x7f0ce406ddf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009830 tx=0x7f0ccc02a520 comp rx=0 tx=0).stop 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 -- 172.21.15.153:0/191319907 shutdown_connections 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/191319907 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce4074b60 0x7f0ce406ddf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/191319907 >> v2:172.21.15.164:3300/0 conn(0x7f0ce4156a50 0x7f0ce4074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 -- 172.21.15.153:0/191319907 >> 172.21.15.153:0/191319907 conn(0x7f0ce40b1b90 msgr2=0x7f0ce40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 -- 172.21.15.153:0/191319907 shutdown_connections 2024-09-17T03:14:39.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.071+0000 7f0ce9a00640 1 -- 172.21.15.153:0/191319907 wait complete. 2024-09-17T03:14:39.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.074+0000 7f0ce9a00640 1 Processor -- start 2024-09-17T03:14:39.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.074+0000 7f0ce9a00640 1 -- start start 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce406e330 0x7f0ce40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce4074b60 0x7f0ce4155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce40ce500 con 0x7f0ce4156a50 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce40ce380 con 0x7f0ce4074b60 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.075+0000 7f0ce9a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce40ce680 con 0x7f0ce406e330 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43882/0 (socket says 172.21.15.153:43882) 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 -- 172.21.15.153:0/891217688 learned_addr learned my addr 172.21.15.153:0/891217688 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce2a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce406e330 0x7f0ce40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0cda000640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce4074b60 0x7f0ce4155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 -- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce406e330 msgr2=0x7f0ce40c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce406e330 0x7f0ce40c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 -- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce4074b60 msgr2=0x7f0ce4155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce4074b60 0x7f0ce4155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 -- 172.21.15.153:0/891217688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce40b5030 con 0x7f0ce4156a50 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0ce3400640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cb40 tx=0x7f0cdc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.076+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc016020 con 0x7f0ce4156a50 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.077+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cdc00ad90 con 0x7f0ce4156a50 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.077+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce40b5310 con 0x7f0ce4156a50 2024-09-17T03:14:39.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.077+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc012680 con 0x7f0ce4156a50 2024-09-17T03:14:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.077+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce40ca940 con 0x7f0ce4156a50 2024-09-17T03:14:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.078+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce40b4da0 con 0x7f0ce4156a50 2024-09-17T03:14:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.079+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cdc019020 con 0x7f0ce4156a50 2024-09-17T03:14:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.080+0000 7f0cdb400640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 0x7f0cc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.080+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0cdc09b490 con 0x7f0ce4156a50 2024-09-17T03:14:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.080+0000 7f0ce2a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 0x7f0cc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.081+0000 7f0ce2a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 0x7f0cc007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009b30 tx=0x7f0cd4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.084+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0cdc020020 con 0x7f0ce4156a50 2024-09-17T03:14:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.303+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0ce406ddf0 con 0x7f0ce4156a50 2024-09-17T03:14:39.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.923+0000 7f0cdb400640 1 -- 172.21.15.153:0/891217688 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f0ce406e740 con 0x7f0ce4156a50 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 msgr2=0x7f0cc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 0x7f0cc007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009b30 tx=0x7f0cd4005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 msgr2=0x7f0ce415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00cb40 tx=0x7f0cdc00a060 comp rx=0 tx=0).stop 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 shutdown_connections 2024-09-17T03:14:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0cc0078b90 0x7f0cc007b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ce4156a50 0x7f0ce415b5f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce4074b60 0x7f0ce4155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 --2- 172.21.15.153:0/891217688 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce406e330 0x7f0ce40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 >> 172.21.15.153:0/891217688 conn(0x7f0ce40b1b90 msgr2=0x7f0ce40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 shutdown_connections 2024-09-17T03:14:39.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:39.926+0000 7f0ce9a00640 1 -- 172.21.15.153:0/891217688 wait complete. 2024-09-17T03:14:39.948 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:14:39.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 -- 172.21.15.153:0/2312305971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa8004d90 msgr2=0x7fbaa8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 --2- 172.21.15.153:0/2312305971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa8004d90 0x7fbaa8005220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009ed0 tx=0x7fbaa8005830 comp rx=0 tx=0).stop 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbac9a00640 1 -- 172.21.15.153:0/2312305971 reap_dead start 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 -- 172.21.15.153:0/2312305971 shutdown_connections 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 -- 172.21.15.153:0/2312305971 >> 172.21.15.153:0/2312305971 conn(0x7fbac406f920 msgr2=0x7fbac40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 -- 172.21.15.153:0/2312305971 shutdown_connections 2024-09-17T03:14:40.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.175+0000 7fbaca400640 1 -- 172.21.15.153:0/2312305971 wait complete. 2024-09-17T03:14:40.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.177+0000 7fbaca400640 1 Processor -- start 2024-09-17T03:14:40.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.178+0000 7fbaca400640 1 -- start start 2024-09-17T03:14:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbaa8004d90 0x7fbac40cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac4143b40 0x7fbac4143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40cddc0 con 0x7fbac4139000 2024-09-17T03:14:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40ccf40 con 0x7fbac4143b40 2024-09-17T03:14:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbaca400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbac40cdf40 con 0x7fbaa8004d90 2024-09-17T03:14:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbabbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbabbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43890/0 (socket says 172.21.15.153:43890) 2024-09-17T03:14:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbabbe00640 1 -- 172.21.15.153:0/303372876 learned_addr learned my addr 172.21.15.153:0/303372876 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbac9000640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbaa8004d90 0x7fbac40cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.179+0000 7fbac9a00640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac4143b40 0x7fbac4143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 -- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbaa8004d90 msgr2=0x7fbac40cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbaa8004d90 0x7fbac40cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 -- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac4143b40 msgr2=0x7fbac4143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac4143b40 0x7fbac4143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 -- 172.21.15.153:0/303372876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac41f9990 con 0x7fbac4139000 2024-09-17T03:14:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbabbe00640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbaac006630 tx=0x7fbaac0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac015070 con 0x7fbac4139000 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaac011840 con 0x7fbac4139000 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac40c6580 con 0x7fbac4139000 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac011c90 con 0x7fbac4139000 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.180+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac41f93d0 con 0x7fbac4139000 2024-09-17T03:14:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.182+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac40ce4a0 con 0x7fbac4139000 2024-09-17T03:14:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.183+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbaac018070 con 0x7fbac4139000 2024-09-17T03:14:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.184+0000 7fbac1600640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 0x7fbaa007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.184+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbaac09bbb0 con 0x7fbac4139000 2024-09-17T03:14:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.185+0000 7fbac9000640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 0x7fbaa007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.185+0000 7fbac9000640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 0x7fbaa007b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4001ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.189+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbac40c6580 con 0x7fbac4139000 2024-09-17T03:14:40.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.409+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbac40cf4f0 con 0x7fbac4139000 2024-09-17T03:14:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.932+0000 7fbac1600640 1 -- 172.21.15.153:0/303372876 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fbaac063770 con 0x7fbac4139000 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 msgr2=0x7fbaa007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 0x7fbaa007b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4001ab0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 msgr2=0x7fbac41f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbaac006630 tx=0x7fbaac0039c0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 shutdown_connections 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbaa0078bc0 0x7fbaa007b0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac4143b40 0x7fbac4143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4139000 0x7fbac41f8a30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 --2- 172.21.15.153:0/303372876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbaa8004d90 0x7fbac40cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.935+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 >> 172.21.15.153:0/303372876 conn(0x7fbac406f920 msgr2=0x7fbac41419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.936+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 shutdown_connections 2024-09-17T03:14:40.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:40.936+0000 7fbaca400640 1 -- 172.21.15.153:0/303372876 wait complete. 2024-09-17T03:14:40.960 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:14:40.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:41.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 -- 172.21.15.153:0/1771156217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 msgr2=0x7f19d806e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 --2- 172.21.15.153:0/1771156217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d806e300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19d0005fd0 tx=0x7f19d002aa80 comp rx=0 tx=0).stop 2024-09-17T03:14:41.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 -- 172.21.15.153:0/1771156217 shutdown_connections 2024-09-17T03:14:41.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 --2- 172.21.15.153:0/1771156217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d806e300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 --2- 172.21.15.153:0/1771156217 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8073dd0 0x7f19d815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 -- 172.21.15.153:0/1771156217 >> 172.21.15.153:0/1771156217 conn(0x7f19d806f940 msgr2=0x7f19d80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 -- 172.21.15.153:0/1771156217 shutdown_connections 2024-09-17T03:14:41.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.183+0000 7f19dca00640 1 -- 172.21.15.153:0/1771156217 wait complete. 2024-09-17T03:14:41.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.185+0000 7f19dca00640 1 Processor -- start 2024-09-17T03:14:41.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.185+0000 7f19dca00640 1 -- start start 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 0x7f19d81f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8152530 0x7f19d81f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80cf5f0 con 0x7f19d806def0 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80cf470 con 0x7f19d8073dd0 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19dca00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f19d80cf770 con 0x7f19d8152530 2024-09-17T03:14:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19d7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19d7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43908/0 (socket says 172.21.15.153:43908) 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19d7400640 1 -- 172.21.15.153:0/3634321115 learned_addr learned my addr 172.21.15.153:0/3634321115 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19d7e00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8152530 0x7f19d81f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.187+0000 7f19cea00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 0x7f19d81f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 -- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8152530 msgr2=0x7f19d81f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8152530 0x7f19d81f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 -- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 msgr2=0x7f19d81f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 0x7f19d81f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 -- 172.21.15.153:0/3634321115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81f8040 con 0x7f19d806def0 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19cea00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 0x7f19d81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19d7400640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19c800d750 tx=0x7f19c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8017070 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19c8004020 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81f3f50 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8004450 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.188+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d815a380 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.189+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d80d0350 con 0x7f19d806def0 2024-09-17T03:14:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.190+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19c80099d0 con 0x7f19d806def0 2024-09-17T03:14:41.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.191+0000 7f19cfe00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 0x7f19b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.191+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f19c809b310 con 0x7f19d806def0 2024-09-17T03:14:41.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.192+0000 7f19cea00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 0x7f19b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.193+0000 7f19cea00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 0x7f19b407b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19d81e5de0 tx=0x7f19c0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.196+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19c8020020 con 0x7f19d806def0 2024-09-17T03:14:41.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.412+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19d815b560 con 0x7f19d806def0 2024-09-17T03:14:41.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.413+0000 7f19cfe00640 1 -- 172.21.15.153:0/3634321115 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f19c8063530 con 0x7f19d806def0 2024-09-17T03:14:41.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:41.412 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"btime":"2024-09-17T03:14:40:924795+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3190390573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3190390573},{"type":"v1","addr":"172.21.15.164:6836","nonce":3190390573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4939,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1750845241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1750845241},{"type":"v1","addr":"172.21.15.164:6837","nonce":1750845241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3449978034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3449978034},{"type":"v1","addr":"172.21.15.153:6834","nonce":3449978034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:40.410947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5004":{"gid":5004,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/402446814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":402446814},{"type":"v1","addr":"172.21.15.153:6835","nonce":402446814}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5004,"qdb_cluster":[5004]},"id":2}]} 2024-09-17T03:14:41.412 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-09-17T03:14:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 msgr2=0x7f19b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 0x7f19b407b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19d81e5de0 tx=0x7f19c0009040 comp rx=0 tx=0).stop 2024-09-17T03:14:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 msgr2=0x7f19d81e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19c800d750 tx=0x7f19c800dc10 comp rx=0 tx=0).stop 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 shutdown_connections 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f19b4078bc0 0x7f19b407b0d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19d8152530 0x7f19d81f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19d8073dd0 0x7f19d81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 --2- 172.21.15.153:0/3634321115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19d806def0 0x7f19d81e4f40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 >> 172.21.15.153:0/3634321115 conn(0x7f19d806f940 msgr2=0x7f19d80b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 shutdown_connections 2024-09-17T03:14:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.415+0000 7f19dca00640 1 -- 172.21.15.153:0/3634321115 wait complete. 2024-09-17T03:14:41.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:41.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 -- 172.21.15.153:0/1069015754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e40d12e0 msgr2=0x7f49e40d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 --2- 172.21.15.153:0/1069015754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e40d12e0 0x7f49e40d16f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005fd0 tx=0x7f49cc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 -- 172.21.15.153:0/1069015754 shutdown_connections 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 --2- 172.21.15.153:0/1069015754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e40d12e0 0x7f49e40d16f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 --2- 172.21.15.153:0/1069015754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e415cb10 0x7f49e415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 -- 172.21.15.153:0/1069015754 >> 172.21.15.153:0/1069015754 conn(0x7f49e40d2350 msgr2=0x7f49e40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 -- 172.21.15.153:0/1069015754 shutdown_connections 2024-09-17T03:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.658+0000 7f49eb000640 1 -- 172.21.15.153:0/1069015754 wait complete. 2024-09-17T03:14:41.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.660+0000 7f49eb000640 1 Processor -- start 2024-09-17T03:14:41.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.661+0000 7f49eb000640 1 -- start start 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e40d12e0 0x7f49e41e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e415cb10 0x7f49e40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40b73e0 con 0x7f49e4160100 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40b7260 con 0x7f49e415cb10 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49eb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f49e4160c20 con 0x7f49e40d12e0 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49e9000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49e9000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43920/0 (socket says 172.21.15.153:43920) 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.662+0000 7f49e9000640 1 -- 172.21.15.153:0/1977999601 learned_addr learned my addr 172.21.15.153:0/1977999601 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49db400640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e415cb10 0x7f49e40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e3e00640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e40d12e0 0x7f49e41e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 -- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e40d12e0 msgr2=0x7f49e41e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e40d12e0 0x7f49e41e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 -- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e415cb10 msgr2=0x7f49e40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e415cb10 0x7f49e40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 -- 172.21.15.153:0/1977999601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e41f8da0 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e9000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49dc002230 tx=0x7f49dc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc003b70 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.663+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49dc003d10 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.664+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41f92d0 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.664+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc005330 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.664+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e41f9890 con 0x7f49e4160100 2024-09-17T03:14:41.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.665+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e41f9040 con 0x7f49e4160100 2024-09-17T03:14:41.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.666+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49dc0056e0 con 0x7f49e4160100 2024-09-17T03:14:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.667+0000 7f49e0c00640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 0x7f49c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.667+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f49dc09ae20 con 0x7f49e4160100 2024-09-17T03:14:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.668+0000 7f49e3e00640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 0x7f49c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.668+0000 7f49e3e00640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 0x7f49c007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009b30 tx=0x7f49d4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.672+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49dc0629e0 con 0x7f49e4160100 2024-09-17T03:14:41.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.858+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49e40d16f0 con 0x7f49e4160100 2024-09-17T03:14:41.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.859+0000 7f49e0c00640 1 -- 172.21.15.153:0/1977999601 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17038 (secure 0 0 0) 0x7f49dc067410 con 0x7f49e4160100 2024-09-17T03:14:41.858 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:41.859 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:14:38.906705+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:35.469865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:36.356142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.862+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 msgr2=0x7f49c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.862+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 0x7f49c007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009b30 tx=0x7f49d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.862+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 msgr2=0x7f49e415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.862+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49dc002230 tx=0x7f49dc00cb90 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 shutdown_connections 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f49c0078b90 0x7f49c007b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e4160100 0x7f49e415b5e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49e415cb10 0x7f49e40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 --2- 172.21.15.153:0/1977999601 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49e40d12e0 0x7f49e41e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 >> 172.21.15.153:0/1977999601 conn(0x7f49e40d2350 msgr2=0x7f49e40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 shutdown_connections 2024-09-17T03:14:41.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:41.863+0000 7f49eb000640 1 -- 172.21.15.153:0/1977999601 wait complete. 2024-09-17T03:14:41.875 INFO:tasks.ceph.mds.c.smithi153.stderr:2024-09-17T03:14:41.876+0000 7fe819600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:14:41.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:14:41.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 -- 172.21.15.153:0/1221432732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee60003a50 msgr2=0x7fee60003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 --2- 172.21.15.153:0/1221432732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee60003a50 0x7fee60003ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009d00 tx=0x7fee60005830 comp rx=0 tx=0).stop 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 -- 172.21.15.153:0/1221432732 shutdown_connections 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 --2- 172.21.15.153:0/1221432732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee60003a50 0x7fee60003ec0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 -- 172.21.15.153:0/1221432732 >> 172.21.15.153:0/1221432732 conn(0x7fee780d1930 msgr2=0x7fee780d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 -- 172.21.15.153:0/1221432732 shutdown_connections 2024-09-17T03:14:42.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.113+0000 7fee7f200640 1 -- 172.21.15.153:0/1221432732 wait complete. 2024-09-17T03:14:42.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.116+0000 7fee7f200640 1 Processor -- start 2024-09-17T03:14:42.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.116+0000 7fee7f200640 1 -- start start 2024-09-17T03:14:42.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee60003a50 0x7fee780d3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 0x7fee7815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee78162640 con 0x7fee78142680 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fee781624c0 con 0x7fee7815ad30 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.117+0000 7fee7f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fee7806d2b0 con 0x7fee60003a50 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43940/0 (socket says 172.21.15.153:43940) 2024-09-17T03:14:42.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 -- 172.21.15.153:0/1579696932 learned_addr learned my addr 172.21.15.153:0/1579696932 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7e800640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 0x7fee7815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7de00640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee60003a50 0x7fee780d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 -- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee60003a50 msgr2=0x7fee780d3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee60003a50 0x7fee780d3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 -- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 msgr2=0x7fee7815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 0x7fee7815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 -- 172.21.15.153:0/1579696932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee780d2740 con 0x7fee78142680 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7e800640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 0x7fee7815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.118+0000 7fee7d400640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fee68006e60 tx=0x7fee680049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.119+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68015020 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.119+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee680109a0 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.119+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee780d2a20 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.119+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68010df0 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.119+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee781592f0 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.120+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee78154ea0 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.121+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee68018020 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.122+0000 7fee72000640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 0x7fee5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.122+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fee6809bb20 con 0x7fee78142680 2024-09-17T03:14:42.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.122+0000 7fee7de00640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 0x7fee5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.123+0000 7fee7de00640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 0x7fee5c07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee6c035000 tx=0x7fee6c0046c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.127+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee6801f020 con 0x7fee78142680 2024-09-17T03:14:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.314+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee781595f0 con 0x7fee5c078b90 2024-09-17T03:14:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.319+0000 7fee72000640 1 -- 172.21.15.153:0/1579696932 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241548 (secure 0 0 0) 0x7fee6c07dfa0 con 0x7fee5c078b90 2024-09-17T03:14:42.319 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 msgr2=0x7fee5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 0x7fee5c07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee6c035000 tx=0x7fee6c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 msgr2=0x7fee780d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fee68006e60 tx=0x7fee680049d0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 shutdown_connections 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fee5c078b90 0x7fee5c07b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7815ad30 0x7fee7815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78142680 0x7fee780d3a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 --2- 172.21.15.153:0/1579696932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee60003a50 0x7fee780d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 >> 172.21.15.153:0/1579696932 conn(0x7fee780d1930 msgr2=0x7fee7815cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 shutdown_connections 2024-09-17T03:14:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.324+0000 7fee7f200640 1 -- 172.21.15.153:0/1579696932 wait complete. 2024-09-17T03:14:42.348 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-17T03:14:40.834547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220772,"kb_used_data":4524,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753948,"statfs":{"total":773094113280,"available":772868042752,"internally_reserved":0,"allocated":4632576,"data_stored":2623698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.949531"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923324+0000","last_change":"2024-09-17T03:14:37.918478+0000","last_active":"2024-09-17T03:14:37.923324+0000","last_peered":"2024-09-17T03:14:37.923324+0000","last_clean":"2024-09-17T03:14:37.923324+0000","last_became_active":"2024-09-17T03:14:37.918150+0000","last_became_peered":"2024-09-17T03:14:37.918150+0000","last_unstale":"2024-09-17T03:14:37.923324+0000","last_undegraded":"2024-09-17T03:14:37.923324+0000","last_fullsized":"2024-09-17T03:14:37.923324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.569385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.921589+0000","last_change":"2024-09-17T03:14:37.910208+0000","last_active":"2024-09-17T03:14:37.921589+0000","last_peered":"2024-09-17T03:14:37.921589+0000","last_clean":"2024-09-17T03:14:37.921589+0000","last_became_active":"2024-09-17T03:14:37.909810+0000","last_became_peered":"2024-09-17T03:14:37.909810+0000","last_unstale":"2024-09-17T03:14:37.921589+0000","last_undegraded":"2024-09-17T03:14:37.921589+0000","last_fullsized":"2024-09-17T03:14:37.921589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890705+0000","last_change":"2024-09-17T03:14:35.890705+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890705+0000","last_undegraded":"2024-09-17T03:14:35.890705+0000","last_fullsized":"2024-09-17T03:14:35.890705+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.926962+0000","last_change":"2024-09-17T03:14:37.912463+0000","last_active":"2024-09-17T03:14:37.926962+0000","last_peered":"2024-09-17T03:14:37.926962+0000","last_clean":"2024-09-17T03:14:37.926962+0000","last_became_active":"2024-09-17T03:14:37.912103+0000","last_became_peered":"2024-09-17T03:14:37.912103+0000","last_unstale":"2024-09-17T03:14:37.926962+0000","last_undegraded":"2024-09-17T03:14:37.926962+0000","last_fullsized":"2024-09-17T03:14:37.926962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.944223+0000","last_change":"2024-09-17T03:14:36.914189+0000","last_active":"2024-09-17T03:14:37.944223+0000","last_peered":"2024-09-17T03:14:37.944223+0000","last_clean":"2024-09-17T03:14:37.944223+0000","last_became_active":"2024-09-17T03:14:36.913759+0000","last_became_peered":"2024-09-17T03:14:36.913759+0000","last_unstale":"2024-09-17T03:14:37.944223+0000","last_undegraded":"2024-09-17T03:14:37.944223+0000","last_fullsized":"2024-09-17T03:14:37.944223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888511+0000","last_change":"2024-09-17T03:14:35.888511+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888511+0000","last_undegraded":"2024-09-17T03:14:35.888511+0000","last_fullsized":"2024-09-17T03:14:35.888511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.930975+0000","last_change":"2024-09-17T03:14:37.929582+0000","last_active":"2024-09-17T03:14:37.930975+0000","last_peered":"2024-09-17T03:14:37.930975+0000","last_clean":"2024-09-17T03:14:37.930975+0000","last_became_active":"2024-09-17T03:14:37.929244+0000","last_became_peered":"2024-09-17T03:14:37.929244+0000","last_unstale":"2024-09-17T03:14:37.930975+0000","last_undegraded":"2024-09-17T03:14:37.930975+0000","last_fullsized":"2024-09-17T03:14:37.930975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:57.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890631+0000","last_change":"2024-09-17T03:14:35.890631+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890631+0000","last_undegraded":"2024-09-17T03:14:35.890631+0000","last_fullsized":"2024-09-17T03:14:35.890631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.889866+0000","last_change":"2024-09-17T03:14:35.889866+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.889866+0000","last_undegraded":"2024-09-17T03:14:35.889866+0000","last_fullsized":"2024-09-17T03:14:35.889866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894630+0000","last_change":"2024-09-17T03:14:35.894630+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894630+0000","last_undegraded":"2024-09-17T03:14:35.894630+0000","last_fullsized":"2024-09-17T03:14:35.894630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887608+0000","last_change":"2024-09-17T03:14:35.887608+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887608+0000","last_undegraded":"2024-09-17T03:14:35.887608+0000","last_fullsized":"2024-09-17T03:14:35.887608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.928836+0000","last_change":"2024-09-17T03:14:37.927188+0000","last_active":"2024-09-17T03:14:37.928836+0000","last_peered":"2024-09-17T03:14:37.928836+0000","last_clean":"2024-09-17T03:14:37.928836+0000","last_became_active":"2024-09-17T03:14:37.923498+0000","last_became_peered":"2024-09-17T03:14:37.923498+0000","last_unstale":"2024-09-17T03:14:37.928836+0000","last_undegraded":"2024-09-17T03:14:37.928836+0000","last_fullsized":"2024-09-17T03:14:37.928836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:23.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894637+0000","last_change":"2024-09-17T03:14:35.894637+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894637+0000","last_undegraded":"2024-09-17T03:14:35.894637+0000","last_fullsized":"2024-09-17T03:14:35.894637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888327+0000","last_change":"2024-09-17T03:14:35.888327+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888327+0000","last_undegraded":"2024-09-17T03:14:35.888327+0000","last_fullsized":"2024-09-17T03:14:35.888327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892805+0000","last_change":"2024-09-17T03:14:35.892805+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892805+0000","last_undegraded":"2024-09-17T03:14:35.892805+0000","last_fullsized":"2024-09-17T03:14:35.892805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891906+0000","last_change":"2024-09-17T03:14:35.891906+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891906+0000","last_undegraded":"2024-09-17T03:14:35.891906+0000","last_fullsized":"2024-09-17T03:14:35.891906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887742+0000","last_change":"2024-09-17T03:14:35.887742+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887742+0000","last_undegraded":"2024-09-17T03:14:35.887742+0000","last_fullsized":"2024-09-17T03:14:35.887742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890236+0000","last_change":"2024-09-17T03:14:35.890236+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890236+0000","last_undegraded":"2024-09-17T03:14:35.890236+0000","last_fullsized":"2024-09-17T03:14:35.890236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.920702+0000","last_change":"2024-09-17T03:14:37.913219+0000","last_active":"2024-09-17T03:14:37.920702+0000","last_peered":"2024-09-17T03:14:37.920702+0000","last_clean":"2024-09-17T03:14:37.920702+0000","last_became_active":"2024-09-17T03:14:37.912848+0000","last_became_peered":"2024-09-17T03:14:37.912848+0000","last_unstale":"2024-09-17T03:14:37.920702+0000","last_undegraded":"2024-09-17T03:14:37.920702+0000","last_fullsized":"2024-09-17T03:14:37.920702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.908019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.901011+0000","last_change":"2024-09-17T03:14:36.906986+0000","last_active":"2024-09-17T03:14:37.901011+0000","last_peered":"2024-09-17T03:14:37.901011+0000","last_clean":"2024-09-17T03:14:37.901011+0000","last_became_active":"2024-09-17T03:14:36.906610+0000","last_became_peered":"2024-09-17T03:14:36.906610+0000","last_unstale":"2024-09-17T03:14:37.901011+0000","last_undegraded":"2024-09-17T03:14:37.901011+0000","last_fullsized":"2024-09-17T03:14:37.901011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:06.494486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892637+0000","last_change":"2024-09-17T03:14:35.892637+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892637+0000","last_undegraded":"2024-09-17T03:14:35.892637+0000","last_fullsized":"2024-09-17T03:14:35.892637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.889747+0000","last_change":"2024-09-17T03:14:35.889747+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.889747+0000","last_undegraded":"2024-09-17T03:14:35.889747+0000","last_fullsized":"2024-09-17T03:14:35.889747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923307+0000","last_change":"2024-09-17T03:14:37.916083+0000","last_active":"2024-09-17T03:14:37.923307+0000","last_peered":"2024-09-17T03:14:37.923307+0000","last_clean":"2024-09-17T03:14:37.923307+0000","last_became_active":"2024-09-17T03:14:37.912339+0000","last_became_peered":"2024-09-17T03:14:37.912339+0000","last_unstale":"2024-09-17T03:14:37.923307+0000","last_undegraded":"2024-09-17T03:14:37.923307+0000","last_fullsized":"2024-09-17T03:14:37.923307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:09.389752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894619+0000","last_change":"2024-09-17T03:14:35.894619+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894619+0000","last_undegraded":"2024-09-17T03:14:35.894619+0000","last_fullsized":"2024-09-17T03:14:35.894619+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892350+0000","last_change":"2024-09-17T03:14:35.892350+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892350+0000","last_undegraded":"2024-09-17T03:14:35.892350+0000","last_fullsized":"2024-09-17T03:14:35.892350+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.896194+0000","last_change":"2024-09-17T03:14:35.896194+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.896194+0000","last_undegraded":"2024-09-17T03:14:35.896194+0000","last_fullsized":"2024-09-17T03:14:35.896194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892593+0000","last_change":"2024-09-17T03:14:35.892593+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892593+0000","last_undegraded":"2024-09-17T03:14:35.892593+0000","last_fullsized":"2024-09-17T03:14:35.892593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892463+0000","last_change":"2024-09-17T03:14:35.892463+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892463+0000","last_undegraded":"2024-09-17T03:14:35.892463+0000","last_fullsized":"2024-09-17T03:14:35.892463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.902420+0000","last_change":"2024-09-17T03:14:36.911465+0000","last_active":"2024-09-17T03:14:37.902420+0000","last_peered":"2024-09-17T03:14:37.902420+0000","last_clean":"2024-09-17T03:14:37.902420+0000","last_became_active":"2024-09-17T03:14:36.910962+0000","last_became_peered":"2024-09-17T03:14:36.910962+0000","last_unstale":"2024-09-17T03:14:37.902420+0000","last_undegraded":"2024-09-17T03:14:37.902420+0000","last_fullsized":"2024-09-17T03:14:37.902420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.148718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895353+0000","last_change":"2024-09-17T03:14:35.895353+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895353+0000","last_undegraded":"2024-09-17T03:14:35.895353+0000","last_fullsized":"2024-09-17T03:14:35.895353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.900455+0000","last_change":"2024-09-17T03:14:36.924434+0000","last_active":"2024-09-17T03:14:37.900455+0000","last_peered":"2024-09-17T03:14:37.900455+0000","last_clean":"2024-09-17T03:14:37.900455+0000","last_became_active":"2024-09-17T03:14:36.922875+0000","last_became_peered":"2024-09-17T03:14:36.922875+0000","last_unstale":"2024-09-17T03:14:37.900455+0000","last_undegraded":"2024-09-17T03:14:37.900455+0000","last_fullsized":"2024-09-17T03:14:37.900455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:26.793869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891839+0000","last_change":"2024-09-17T03:14:35.891839+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891839+0000","last_undegraded":"2024-09-17T03:14:35.891839+0000","last_fullsized":"2024-09-17T03:14:35.891839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895878+0000","last_change":"2024-09-17T03:14:35.895878+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895878+0000","last_undegraded":"2024-09-17T03:14:35.895878+0000","last_fullsized":"2024-09-17T03:14:35.895878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895123+0000","last_change":"2024-09-17T03:14:35.895123+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895123+0000","last_undegraded":"2024-09-17T03:14:35.895123+0000","last_fullsized":"2024-09-17T03:14:35.895123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888940+0000","last_change":"2024-09-17T03:14:35.888940+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888940+0000","last_undegraded":"2024-09-17T03:14:35.888940+0000","last_fullsized":"2024-09-17T03:14:35.888940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.929687+0000","last_change":"2024-09-17T03:14:37.928215+0000","last_active":"2024-09-17T03:14:37.929687+0000","last_peered":"2024-09-17T03:14:37.929687+0000","last_clean":"2024-09-17T03:14:37.929687+0000","last_became_active":"2024-09-17T03:14:37.927665+0000","last_became_peered":"2024-09-17T03:14:37.927665+0000","last_unstale":"2024-09-17T03:14:37.929687+0000","last_undegraded":"2024-09-17T03:14:37.929687+0000","last_fullsized":"2024-09-17T03:14:37.929687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:45.439704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891391+0000","last_change":"2024-09-17T03:14:35.891391+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891391+0000","last_undegraded":"2024-09-17T03:14:35.891391+0000","last_fullsized":"2024-09-17T03:14:35.891391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891955+0000","last_change":"2024-09-17T03:14:35.891955+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891955+0000","last_undegraded":"2024-09-17T03:14:35.891955+0000","last_fullsized":"2024-09-17T03:14:35.891955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887638+0000","last_change":"2024-09-17T03:14:35.887638+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887638+0000","last_undegraded":"2024-09-17T03:14:35.887638+0000","last_fullsized":"2024-09-17T03:14:35.887638+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891590+0000","last_change":"2024-09-17T03:14:35.891590+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891590+0000","last_undegraded":"2024-09-17T03:14:35.891590+0000","last_fullsized":"2024-09-17T03:14:35.891590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":138,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-17T03:14:35.896001+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:14:35.896001+0000","last_peered":"2024-09-17T03:14:35.896001+0000","last_clean":"2024-09-17T03:14:35.896001+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:14:35.896001+0000","last_undegraded":"2024-09-17T03:14:35.896001+0000","last_fullsized":"2024-09-17T03:14:35.896001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":417792,"data_stored":173980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":770557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":770557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":417792,"data_stored":173980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:42.353 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 -- 172.21.15.153:0/947804286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c06e500 msgr2=0x7f9d0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 --2- 172.21.15.153:0/947804286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c06e500 0x7f9d0c06ede0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9d04005fd0 tx=0x7f9d0402ab40 comp rx=0 tx=0).stop 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 -- 172.21.15.153:0/947804286 shutdown_connections 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 --2- 172.21.15.153:0/947804286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c06e500 0x7f9d0c06ede0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 -- 172.21.15.153:0/947804286 >> 172.21.15.153:0/947804286 conn(0x7f9d0c0cca40 msgr2=0x7f9d0c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 -- 172.21.15.153:0/947804286 shutdown_connections 2024-09-17T03:14:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.619+0000 7f9d13e00640 1 -- 172.21.15.153:0/947804286 wait complete. 2024-09-17T03:14:42.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.621+0000 7f9d13e00640 1 Processor -- start 2024-09-17T03:14:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.622+0000 7f9d13e00640 1 -- start start 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d0c073dd0 0x7f9d0c1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d0c09d620 0x7f9d0c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c06f6b0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c06f530 con 0x7f9d0c073dd0 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d13e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0c06f830 con 0x7f9d0c09d620 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d10a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d10a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43954/0 (socket says 172.21.15.153:43954) 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d10a00640 1 -- 172.21.15.153:0/167491340 learned_addr learned my addr 172.21.15.153:0/167491340 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d11400640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d0c073dd0 0x7f9d0c1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.623+0000 7f9d11e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d0c09d620 0x7f9d0c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 -- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d0c09d620 msgr2=0x7f9d0c0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d0c09d620 0x7f9d0c0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 -- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d0c073dd0 msgr2=0x7f9d0c1f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d0c073dd0 0x7f9d0c1f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 -- 172.21.15.153:0/167491340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c0c97f0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d10a00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800c3c0 tx=0x7f9cf800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8017070 con 0x7f9d0c074cb0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf80035f0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8003a40 con 0x7f9d0c074cb0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.624+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c09dd00 con 0x7f9d0c074cb0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.625+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c09bf80 con 0x7f9d0c074cb0 2024-09-17T03:14:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.626+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c15f3e0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.627+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cf801a070 con 0x7f9d0c074cb0 2024-09-17T03:14:42.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.628+0000 7f9d09600640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 0x7f9cec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.629+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f9cf809a0e0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.629+0000 7f9d11400640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 0x7f9cec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.630+0000 7f9d11400640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 0x7f9cec07b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000f60 tx=0x7f9d00009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.633+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d0c15f3e0 con 0x7f9d0c074cb0 2024-09-17T03:14:42.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.815+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d0c09da90 con 0x7f9cec078bc0 2024-09-17T03:14:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.820+0000 7f9d09600640 1 -- 172.21.15.153:0/167491340 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241548 (secure 0 0 0) 0x7f9d0c09da90 con 0x7f9cec078bc0 2024-09-17T03:14:42.822 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:14:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 msgr2=0x7f9cec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 0x7f9cec07b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000f60 tx=0x7f9d00009040 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 msgr2=0x7f9d0c09ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800c3c0 tx=0x7f9cf800c880 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 shutdown_connections 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9cec078bc0 0x7f9cec07b0d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d0c09d620 0x7f9d0c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d0c074cb0 0x7f9d0c09ca60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 --2- 172.21.15.153:0/167491340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d0c073dd0 0x7f9d0c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 >> 172.21.15.153:0/167491340 conn(0x7f9d0c0cca40 msgr2=0x7f9d0c068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 shutdown_connections 2024-09-17T03:14:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:42.824+0000 7f9d13e00640 1 -- 172.21.15.153:0/167491340 wait complete. 2024-09-17T03:14:42.845 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-17T03:14:40.834547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220772,"kb_used_data":4524,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753948,"statfs":{"total":773094113280,"available":772868042752,"internally_reserved":0,"allocated":4632576,"data_stored":2623698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.949531"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923324+0000","last_change":"2024-09-17T03:14:37.918478+0000","last_active":"2024-09-17T03:14:37.923324+0000","last_peered":"2024-09-17T03:14:37.923324+0000","last_clean":"2024-09-17T03:14:37.923324+0000","last_became_active":"2024-09-17T03:14:37.918150+0000","last_became_peered":"2024-09-17T03:14:37.918150+0000","last_unstale":"2024-09-17T03:14:37.923324+0000","last_undegraded":"2024-09-17T03:14:37.923324+0000","last_fullsized":"2024-09-17T03:14:37.923324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.569385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.921589+0000","last_change":"2024-09-17T03:14:37.910208+0000","last_active":"2024-09-17T03:14:37.921589+0000","last_peered":"2024-09-17T03:14:37.921589+0000","last_clean":"2024-09-17T03:14:37.921589+0000","last_became_active":"2024-09-17T03:14:37.909810+0000","last_became_peered":"2024-09-17T03:14:37.909810+0000","last_unstale":"2024-09-17T03:14:37.921589+0000","last_undegraded":"2024-09-17T03:14:37.921589+0000","last_fullsized":"2024-09-17T03:14:37.921589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890705+0000","last_change":"2024-09-17T03:14:35.890705+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890705+0000","last_undegraded":"2024-09-17T03:14:35.890705+0000","last_fullsized":"2024-09-17T03:14:35.890705+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.926962+0000","last_change":"2024-09-17T03:14:37.912463+0000","last_active":"2024-09-17T03:14:37.926962+0000","last_peered":"2024-09-17T03:14:37.926962+0000","last_clean":"2024-09-17T03:14:37.926962+0000","last_became_active":"2024-09-17T03:14:37.912103+0000","last_became_peered":"2024-09-17T03:14:37.912103+0000","last_unstale":"2024-09-17T03:14:37.926962+0000","last_undegraded":"2024-09-17T03:14:37.926962+0000","last_fullsized":"2024-09-17T03:14:37.926962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.944223+0000","last_change":"2024-09-17T03:14:36.914189+0000","last_active":"2024-09-17T03:14:37.944223+0000","last_peered":"2024-09-17T03:14:37.944223+0000","last_clean":"2024-09-17T03:14:37.944223+0000","last_became_active":"2024-09-17T03:14:36.913759+0000","last_became_peered":"2024-09-17T03:14:36.913759+0000","last_unstale":"2024-09-17T03:14:37.944223+0000","last_undegraded":"2024-09-17T03:14:37.944223+0000","last_fullsized":"2024-09-17T03:14:37.944223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888511+0000","last_change":"2024-09-17T03:14:35.888511+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888511+0000","last_undegraded":"2024-09-17T03:14:35.888511+0000","last_fullsized":"2024-09-17T03:14:35.888511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.930975+0000","last_change":"2024-09-17T03:14:37.929582+0000","last_active":"2024-09-17T03:14:37.930975+0000","last_peered":"2024-09-17T03:14:37.930975+0000","last_clean":"2024-09-17T03:14:37.930975+0000","last_became_active":"2024-09-17T03:14:37.929244+0000","last_became_peered":"2024-09-17T03:14:37.929244+0000","last_unstale":"2024-09-17T03:14:37.930975+0000","last_undegraded":"2024-09-17T03:14:37.930975+0000","last_fullsized":"2024-09-17T03:14:37.930975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:57.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890631+0000","last_change":"2024-09-17T03:14:35.890631+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890631+0000","last_undegraded":"2024-09-17T03:14:35.890631+0000","last_fullsized":"2024-09-17T03:14:35.890631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.889866+0000","last_change":"2024-09-17T03:14:35.889866+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.889866+0000","last_undegraded":"2024-09-17T03:14:35.889866+0000","last_fullsized":"2024-09-17T03:14:35.889866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894630+0000","last_change":"2024-09-17T03:14:35.894630+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894630+0000","last_undegraded":"2024-09-17T03:14:35.894630+0000","last_fullsized":"2024-09-17T03:14:35.894630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887608+0000","last_change":"2024-09-17T03:14:35.887608+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887608+0000","last_undegraded":"2024-09-17T03:14:35.887608+0000","last_fullsized":"2024-09-17T03:14:35.887608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.928836+0000","last_change":"2024-09-17T03:14:37.927188+0000","last_active":"2024-09-17T03:14:37.928836+0000","last_peered":"2024-09-17T03:14:37.928836+0000","last_clean":"2024-09-17T03:14:37.928836+0000","last_became_active":"2024-09-17T03:14:37.923498+0000","last_became_peered":"2024-09-17T03:14:37.923498+0000","last_unstale":"2024-09-17T03:14:37.928836+0000","last_undegraded":"2024-09-17T03:14:37.928836+0000","last_fullsized":"2024-09-17T03:14:37.928836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:23.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894637+0000","last_change":"2024-09-17T03:14:35.894637+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894637+0000","last_undegraded":"2024-09-17T03:14:35.894637+0000","last_fullsized":"2024-09-17T03:14:35.894637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888327+0000","last_change":"2024-09-17T03:14:35.888327+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888327+0000","last_undegraded":"2024-09-17T03:14:35.888327+0000","last_fullsized":"2024-09-17T03:14:35.888327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892805+0000","last_change":"2024-09-17T03:14:35.892805+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892805+0000","last_undegraded":"2024-09-17T03:14:35.892805+0000","last_fullsized":"2024-09-17T03:14:35.892805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891906+0000","last_change":"2024-09-17T03:14:35.891906+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891906+0000","last_undegraded":"2024-09-17T03:14:35.891906+0000","last_fullsized":"2024-09-17T03:14:35.891906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887742+0000","last_change":"2024-09-17T03:14:35.887742+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887742+0000","last_undegraded":"2024-09-17T03:14:35.887742+0000","last_fullsized":"2024-09-17T03:14:35.887742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.890236+0000","last_change":"2024-09-17T03:14:35.890236+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.890236+0000","last_undegraded":"2024-09-17T03:14:35.890236+0000","last_fullsized":"2024-09-17T03:14:35.890236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.920702+0000","last_change":"2024-09-17T03:14:37.913219+0000","last_active":"2024-09-17T03:14:37.920702+0000","last_peered":"2024-09-17T03:14:37.920702+0000","last_clean":"2024-09-17T03:14:37.920702+0000","last_became_active":"2024-09-17T03:14:37.912848+0000","last_became_peered":"2024-09-17T03:14:37.912848+0000","last_unstale":"2024-09-17T03:14:37.920702+0000","last_undegraded":"2024-09-17T03:14:37.920702+0000","last_fullsized":"2024-09-17T03:14:37.920702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.908019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.901011+0000","last_change":"2024-09-17T03:14:36.906986+0000","last_active":"2024-09-17T03:14:37.901011+0000","last_peered":"2024-09-17T03:14:37.901011+0000","last_clean":"2024-09-17T03:14:37.901011+0000","last_became_active":"2024-09-17T03:14:36.906610+0000","last_became_peered":"2024-09-17T03:14:36.906610+0000","last_unstale":"2024-09-17T03:14:37.901011+0000","last_undegraded":"2024-09-17T03:14:37.901011+0000","last_fullsized":"2024-09-17T03:14:37.901011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:06.494486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892637+0000","last_change":"2024-09-17T03:14:35.892637+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892637+0000","last_undegraded":"2024-09-17T03:14:35.892637+0000","last_fullsized":"2024-09-17T03:14:35.892637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.889747+0000","last_change":"2024-09-17T03:14:35.889747+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.889747+0000","last_undegraded":"2024-09-17T03:14:35.889747+0000","last_fullsized":"2024-09-17T03:14:35.889747+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923307+0000","last_change":"2024-09-17T03:14:37.916083+0000","last_active":"2024-09-17T03:14:37.923307+0000","last_peered":"2024-09-17T03:14:37.923307+0000","last_clean":"2024-09-17T03:14:37.923307+0000","last_became_active":"2024-09-17T03:14:37.912339+0000","last_became_peered":"2024-09-17T03:14:37.912339+0000","last_unstale":"2024-09-17T03:14:37.923307+0000","last_undegraded":"2024-09-17T03:14:37.923307+0000","last_fullsized":"2024-09-17T03:14:37.923307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:09.389752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.894619+0000","last_change":"2024-09-17T03:14:35.894619+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.894619+0000","last_undegraded":"2024-09-17T03:14:35.894619+0000","last_fullsized":"2024-09-17T03:14:35.894619+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892350+0000","last_change":"2024-09-17T03:14:35.892350+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892350+0000","last_undegraded":"2024-09-17T03:14:35.892350+0000","last_fullsized":"2024-09-17T03:14:35.892350+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.896194+0000","last_change":"2024-09-17T03:14:35.896194+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.896194+0000","last_undegraded":"2024-09-17T03:14:35.896194+0000","last_fullsized":"2024-09-17T03:14:35.896194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892593+0000","last_change":"2024-09-17T03:14:35.892593+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892593+0000","last_undegraded":"2024-09-17T03:14:35.892593+0000","last_fullsized":"2024-09-17T03:14:35.892593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.892463+0000","last_change":"2024-09-17T03:14:35.892463+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.892463+0000","last_undegraded":"2024-09-17T03:14:35.892463+0000","last_fullsized":"2024-09-17T03:14:35.892463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.902420+0000","last_change":"2024-09-17T03:14:36.911465+0000","last_active":"2024-09-17T03:14:37.902420+0000","last_peered":"2024-09-17T03:14:37.902420+0000","last_clean":"2024-09-17T03:14:37.902420+0000","last_became_active":"2024-09-17T03:14:36.910962+0000","last_became_peered":"2024-09-17T03:14:36.910962+0000","last_unstale":"2024-09-17T03:14:37.902420+0000","last_undegraded":"2024-09-17T03:14:37.902420+0000","last_fullsized":"2024-09-17T03:14:37.902420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.148718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895353+0000","last_change":"2024-09-17T03:14:35.895353+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895353+0000","last_undegraded":"2024-09-17T03:14:35.895353+0000","last_fullsized":"2024-09-17T03:14:35.895353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.900455+0000","last_change":"2024-09-17T03:14:36.924434+0000","last_active":"2024-09-17T03:14:37.900455+0000","last_peered":"2024-09-17T03:14:37.900455+0000","last_clean":"2024-09-17T03:14:37.900455+0000","last_became_active":"2024-09-17T03:14:36.922875+0000","last_became_peered":"2024-09-17T03:14:36.922875+0000","last_unstale":"2024-09-17T03:14:37.900455+0000","last_undegraded":"2024-09-17T03:14:37.900455+0000","last_fullsized":"2024-09-17T03:14:37.900455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:26.793869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891839+0000","last_change":"2024-09-17T03:14:35.891839+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891839+0000","last_undegraded":"2024-09-17T03:14:35.891839+0000","last_fullsized":"2024-09-17T03:14:35.891839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895878+0000","last_change":"2024-09-17T03:14:35.895878+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895878+0000","last_undegraded":"2024-09-17T03:14:35.895878+0000","last_fullsized":"2024-09-17T03:14:35.895878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.895123+0000","last_change":"2024-09-17T03:14:35.895123+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.895123+0000","last_undegraded":"2024-09-17T03:14:35.895123+0000","last_fullsized":"2024-09-17T03:14:35.895123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.888940+0000","last_change":"2024-09-17T03:14:35.888940+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.888940+0000","last_undegraded":"2024-09-17T03:14:35.888940+0000","last_fullsized":"2024-09-17T03:14:35.888940+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.929687+0000","last_change":"2024-09-17T03:14:37.928215+0000","last_active":"2024-09-17T03:14:37.929687+0000","last_peered":"2024-09-17T03:14:37.929687+0000","last_clean":"2024-09-17T03:14:37.929687+0000","last_became_active":"2024-09-17T03:14:37.927665+0000","last_became_peered":"2024-09-17T03:14:37.927665+0000","last_unstale":"2024-09-17T03:14:37.929687+0000","last_undegraded":"2024-09-17T03:14:37.929687+0000","last_fullsized":"2024-09-17T03:14:37.929687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:45.439704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891391+0000","last_change":"2024-09-17T03:14:35.891391+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891391+0000","last_undegraded":"2024-09-17T03:14:35.891391+0000","last_fullsized":"2024-09-17T03:14:35.891391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891955+0000","last_change":"2024-09-17T03:14:35.891955+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891955+0000","last_undegraded":"2024-09-17T03:14:35.891955+0000","last_fullsized":"2024-09-17T03:14:35.891955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.887638+0000","last_change":"2024-09-17T03:14:35.887638+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.887638+0000","last_undegraded":"2024-09-17T03:14:35.887638+0000","last_fullsized":"2024-09-17T03:14:35.887638+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:14:36.883541+0000","last_change":"2024-09-17T03:14:36.883541+0000","last_active":"2024-09-17T03:14:36.883541+0000","last_peered":"2024-09-17T03:14:36.883541+0000","last_clean":"2024-09-17T03:14:36.883541+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:36.883541+0000","last_undegraded":"2024-09-17T03:14:36.883541+0000","last_fullsized":"2024-09-17T03:14:36.883541+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-17T03:14:35.891590+0000","last_change":"2024-09-17T03:14:35.891590+0000","last_active":"2024-09-17T03:14:35.873656+0000","last_peered":"2024-09-17T03:14:35.873656+0000","last_clean":"2024-09-17T03:14:35.873656+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:14:35.891590+0000","last_undegraded":"2024-09-17T03:14:35.891590+0000","last_fullsized":"2024-09-17T03:14:35.891590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":138,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-17T03:14:35.896001+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:14:35.896001+0000","last_peered":"2024-09-17T03:14:35.896001+0000","last_clean":"2024-09-17T03:14:35.896001+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:14:35.896001+0000","last_undegraded":"2024-09-17T03:14:35.896001+0000","last_fullsized":"2024-09-17T03:14:35.896001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":417792,"data_stored":173980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":770557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":180189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":770557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":417792,"data_stored":173980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:42.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 -- 172.21.15.153:0/294211416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 msgr2=0x7f39780b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 --2- 172.21.15.153:0/294211416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f39780b2ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3968005fd0 tx=0x7f396802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 -- 172.21.15.153:0/294211416 shutdown_connections 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 --2- 172.21.15.153:0/294211416 >> v2:172.21.15.164:3300/0 conn(0x7f397806e170 0x7f39780cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 --2- 172.21.15.153:0/294211416 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f39780b2ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 -- 172.21.15.153:0/294211416 >> 172.21.15.153:0/294211416 conn(0x7f397806f940 msgr2=0x7f39780b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 -- 172.21.15.153:0/294211416 shutdown_connections 2024-09-17T03:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.105+0000 7f397cc00640 1 -- 172.21.15.153:0/294211416 wait complete. 2024-09-17T03:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.107+0000 7f397cc00640 1 Processor -- start 2024-09-17T03:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.108+0000 7f397cc00640 1 -- start start 2024-09-17T03:14:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f397806e170 0x7f3978142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f3978156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39780ccac0 con 0x7f397815aa90 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39780cc940 con 0x7f397806e170 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f397cc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f39780ccc40 con 0x7f39780cf940 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f3977e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f3977e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43960/0 (socket says 172.21.15.153:43960) 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.109+0000 7f3977e00640 1 -- 172.21.15.153:0/433066800 learned_addr learned my addr 172.21.15.153:0/433066800 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977400640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f397806e170 0x7f3978142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f396ea00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f3978156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 -- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 msgr2=0x7f3978156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f3978156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 -- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f397806e170 msgr2=0x7f3978142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f397806e170 0x7f3978142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 -- 172.21.15.153:0/433066800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781f7030 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f3977e00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f397000aee0 tx=0x7f397000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970003b70 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3970003d10 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39781f7310 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.110+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970004280 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.111+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3978142dc0 con 0x7f397815aa90 2024-09-17T03:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.112+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39780b2ed0 con 0x7f397815aa90 2024-09-17T03:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.113+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3970004420 con 0x7f397815aa90 2024-09-17T03:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.114+0000 7f396fe00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 0x7f395407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.114+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f397009b8e0 con 0x7f397815aa90 2024-09-17T03:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.114+0000 7f3977400640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 0x7f395407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.115+0000 7f3977400640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 0x7f395407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3968033000 tx=0x7f3968004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.118+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f397000ee20 con 0x7f397815aa90 2024-09-17T03:14:43.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.300+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39781588c0 con 0x7f3954078b90 2024-09-17T03:14:43.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.306+0000 7f396fe00640 1 -- 172.21.15.153:0/433066800 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f39781588c0 con 0x7f3954078b90 2024-09-17T03:14:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:43.309 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:14:43.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 msgr2=0x7f395407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 0x7f395407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3968033000 tx=0x7f3968004730 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 msgr2=0x7f3978157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f397000aee0 tx=0x7f397000c7a0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 shutdown_connections 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3954078b90 0x7f395407b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f397815aa90 0x7f3978157510 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39780cf940 0x7f3978156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.309+0000 7f397cc00640 1 --2- 172.21.15.153:0/433066800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f397806e170 0x7f3978142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.310+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 >> 172.21.15.153:0/433066800 conn(0x7f397806f940 msgr2=0x7f397815b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.310+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 shutdown_connections 2024-09-17T03:14:43.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.310+0000 7f397cc00640 1 -- 172.21.15.153:0/433066800 wait complete. 2024-09-17T03:14:43.332 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-17T03:14:42.834966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":4976640,"data_stored":2784584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919963+0000","last_change":"2024-09-17T03:14:37.916561+0000","last_active":"2024-09-17T03:14:38.919963+0000","last_peered":"2024-09-17T03:14:38.919963+0000","last_clean":"2024-09-17T03:14:38.919963+0000","last_became_active":"2024-09-17T03:14:37.916223+0000","last_became_peered":"2024-09-17T03:14:37.916223+0000","last_unstale":"2024-09-17T03:14:38.919963+0000","last_undegraded":"2024-09-17T03:14:38.919963+0000","last_fullsized":"2024-09-17T03:14:38.919963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:08.134288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923324+0000","last_change":"2024-09-17T03:14:37.918478+0000","last_active":"2024-09-17T03:14:37.923324+0000","last_peered":"2024-09-17T03:14:37.923324+0000","last_clean":"2024-09-17T03:14:37.923324+0000","last_became_active":"2024-09-17T03:14:37.918150+0000","last_became_peered":"2024-09-17T03:14:37.918150+0000","last_unstale":"2024-09-17T03:14:37.923324+0000","last_undegraded":"2024-09-17T03:14:37.923324+0000","last_fullsized":"2024-09-17T03:14:37.923324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.569385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919826+0000","last_change":"2024-09-17T03:14:37.918446+0000","last_active":"2024-09-17T03:14:38.919826+0000","last_peered":"2024-09-17T03:14:38.919826+0000","last_clean":"2024-09-17T03:14:38.919826+0000","last_became_active":"2024-09-17T03:14:37.911192+0000","last_became_peered":"2024-09-17T03:14:37.911192+0000","last_unstale":"2024-09-17T03:14:38.919826+0000","last_undegraded":"2024-09-17T03:14:38.919826+0000","last_fullsized":"2024-09-17T03:14:38.919826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:32.884580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919292+0000","last_change":"2024-09-17T03:14:37.925347+0000","last_active":"2024-09-17T03:14:38.919292+0000","last_peered":"2024-09-17T03:14:38.919292+0000","last_clean":"2024-09-17T03:14:38.919292+0000","last_became_active":"2024-09-17T03:14:37.924709+0000","last_became_peered":"2024-09-17T03:14:37.924709+0000","last_unstale":"2024-09-17T03:14:38.919292+0000","last_undegraded":"2024-09-17T03:14:38.919292+0000","last_fullsized":"2024-09-17T03:14:38.919292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:36.973784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917716+0000","last_change":"2024-09-17T03:14:37.935833+0000","last_active":"2024-09-17T03:14:38.917716+0000","last_peered":"2024-09-17T03:14:38.917716+0000","last_clean":"2024-09-17T03:14:38.917716+0000","last_became_active":"2024-09-17T03:14:37.935518+0000","last_became_peered":"2024-09-17T03:14:37.935518+0000","last_unstale":"2024-09-17T03:14:38.917716+0000","last_undegraded":"2024-09-17T03:14:38.917716+0000","last_fullsized":"2024-09-17T03:14:38.917716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:55.741697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.921589+0000","last_change":"2024-09-17T03:14:37.910208+0000","last_active":"2024-09-17T03:14:37.921589+0000","last_peered":"2024-09-17T03:14:37.921589+0000","last_clean":"2024-09-17T03:14:37.921589+0000","last_became_active":"2024-09-17T03:14:37.909810+0000","last_became_peered":"2024-09-17T03:14:37.909810+0000","last_unstale":"2024-09-17T03:14:37.921589+0000","last_undegraded":"2024-09-17T03:14:37.921589+0000","last_fullsized":"2024-09-17T03:14:37.921589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915499+0000","last_change":"2024-09-17T03:14:37.921919+0000","last_active":"2024-09-17T03:14:38.915499+0000","last_peered":"2024-09-17T03:14:38.915499+0000","last_clean":"2024-09-17T03:14:38.915499+0000","last_became_active":"2024-09-17T03:14:37.921605+0000","last_became_peered":"2024-09-17T03:14:37.921605+0000","last_unstale":"2024-09-17T03:14:38.915499+0000","last_undegraded":"2024-09-17T03:14:38.915499+0000","last_fullsized":"2024-09-17T03:14:38.915499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:04.482880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918503+0000","last_change":"2024-09-17T03:14:37.929874+0000","last_active":"2024-09-17T03:14:38.918503+0000","last_peered":"2024-09-17T03:14:38.918503+0000","last_clean":"2024-09-17T03:14:38.918503+0000","last_became_active":"2024-09-17T03:14:37.929183+0000","last_became_peered":"2024-09-17T03:14:37.929183+0000","last_unstale":"2024-09-17T03:14:38.918503+0000","last_undegraded":"2024-09-17T03:14:38.918503+0000","last_fullsized":"2024-09-17T03:14:38.918503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:07.984867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918320+0000","last_change":"2024-09-17T03:14:37.942264+0000","last_active":"2024-09-17T03:14:38.918320+0000","last_peered":"2024-09-17T03:14:38.918320+0000","last_clean":"2024-09-17T03:14:38.918320+0000","last_became_active":"2024-09-17T03:14:37.942048+0000","last_became_peered":"2024-09-17T03:14:37.942048+0000","last_unstale":"2024-09-17T03:14:38.918320+0000","last_undegraded":"2024-09-17T03:14:38.918320+0000","last_fullsized":"2024-09-17T03:14:38.918320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:47.951479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916140+0000","last_change":"2024-09-17T03:14:37.925527+0000","last_active":"2024-09-17T03:14:38.916140+0000","last_peered":"2024-09-17T03:14:38.916140+0000","last_clean":"2024-09-17T03:14:38.916140+0000","last_became_active":"2024-09-17T03:14:37.925210+0000","last_became_peered":"2024-09-17T03:14:37.925210+0000","last_unstale":"2024-09-17T03:14:38.916140+0000","last_undegraded":"2024-09-17T03:14:38.916140+0000","last_fullsized":"2024-09-17T03:14:38.916140+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:22.863410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905176+0000","last_change":"2024-09-17T03:14:37.933221+0000","last_active":"2024-09-17T03:14:39.905176+0000","last_peered":"2024-09-17T03:14:39.905176+0000","last_clean":"2024-09-17T03:14:39.905176+0000","last_became_active":"2024-09-17T03:14:37.931240+0000","last_became_peered":"2024-09-17T03:14:37.931240+0000","last_unstale":"2024-09-17T03:14:39.905176+0000","last_undegraded":"2024-09-17T03:14:39.905176+0000","last_fullsized":"2024-09-17T03:14:39.905176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:54.899035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918082+0000","last_change":"2024-09-17T03:14:37.928051+0000","last_active":"2024-09-17T03:14:38.918082+0000","last_peered":"2024-09-17T03:14:38.918082+0000","last_clean":"2024-09-17T03:14:38.918082+0000","last_became_active":"2024-09-17T03:14:37.927608+0000","last_became_peered":"2024-09-17T03:14:37.927608+0000","last_unstale":"2024-09-17T03:14:38.918082+0000","last_undegraded":"2024-09-17T03:14:38.918082+0000","last_fullsized":"2024-09-17T03:14:38.918082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:48.723198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915524+0000","last_change":"2024-09-17T03:14:37.916003+0000","last_active":"2024-09-17T03:14:38.915524+0000","last_peered":"2024-09-17T03:14:38.915524+0000","last_clean":"2024-09-17T03:14:38.915524+0000","last_became_active":"2024-09-17T03:14:37.915694+0000","last_became_peered":"2024-09-17T03:14:37.915694+0000","last_unstale":"2024-09-17T03:14:38.915524+0000","last_undegraded":"2024-09-17T03:14:38.915524+0000","last_fullsized":"2024-09-17T03:14:38.915524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:46.763114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247901+0000","last_change":"2024-09-17T03:14:37.923019+0000","last_active":"2024-09-17T03:14:40.247901+0000","last_peered":"2024-09-17T03:14:40.247901+0000","last_clean":"2024-09-17T03:14:40.247901+0000","last_became_active":"2024-09-17T03:14:37.922617+0000","last_became_peered":"2024-09-17T03:14:37.922617+0000","last_unstale":"2024-09-17T03:14:40.247901+0000","last_undegraded":"2024-09-17T03:14:40.247901+0000","last_fullsized":"2024-09-17T03:14:40.247901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:14.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.666997+0000","last_change":"2024-09-17T03:14:37.921909+0000","last_active":"2024-09-17T03:14:39.666997+0000","last_peered":"2024-09-17T03:14:39.666997+0000","last_clean":"2024-09-17T03:14:39.666997+0000","last_became_active":"2024-09-17T03:14:37.921309+0000","last_became_peered":"2024-09-17T03:14:37.921309+0000","last_unstale":"2024-09-17T03:14:39.666997+0000","last_undegraded":"2024-09-17T03:14:39.666997+0000","last_fullsized":"2024-09-17T03:14:39.666997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:05.255693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915715+0000","last_change":"2024-09-17T03:14:37.914801+0000","last_active":"2024-09-17T03:14:38.915715+0000","last_peered":"2024-09-17T03:14:38.915715+0000","last_clean":"2024-09-17T03:14:38.915715+0000","last_became_active":"2024-09-17T03:14:37.914491+0000","last_became_peered":"2024-09-17T03:14:37.914491+0000","last_unstale":"2024-09-17T03:14:38.915715+0000","last_undegraded":"2024-09-17T03:14:38.915715+0000","last_fullsized":"2024-09-17T03:14:38.915715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:20.802554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667600+0000","last_change":"2024-09-17T03:14:37.937593+0000","last_active":"2024-09-17T03:14:39.667600+0000","last_peered":"2024-09-17T03:14:39.667600+0000","last_clean":"2024-09-17T03:14:39.667600+0000","last_became_active":"2024-09-17T03:14:37.937342+0000","last_became_peered":"2024-09-17T03:14:37.937342+0000","last_unstale":"2024-09-17T03:14:39.667600+0000","last_undegraded":"2024-09-17T03:14:39.667600+0000","last_fullsized":"2024-09-17T03:14:39.667600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:23.222179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667556+0000","last_change":"2024-09-17T03:14:37.934795+0000","last_active":"2024-09-17T03:14:39.667556+0000","last_peered":"2024-09-17T03:14:39.667556+0000","last_clean":"2024-09-17T03:14:39.667556+0000","last_became_active":"2024-09-17T03:14:37.934439+0000","last_became_peered":"2024-09-17T03:14:37.934439+0000","last_unstale":"2024-09-17T03:14:39.667556+0000","last_undegraded":"2024-09-17T03:14:39.667556+0000","last_fullsized":"2024-09-17T03:14:39.667556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:52.920067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888271+0000","last_change":"2024-09-17T03:14:37.915377+0000","last_active":"2024-09-17T03:14:39.888271+0000","last_peered":"2024-09-17T03:14:39.888271+0000","last_clean":"2024-09-17T03:14:39.888271+0000","last_became_active":"2024-09-17T03:14:37.914255+0000","last_became_peered":"2024-09-17T03:14:37.914255+0000","last_unstale":"2024-09-17T03:14:39.888271+0000","last_undegraded":"2024-09-17T03:14:39.888271+0000","last_fullsized":"2024-09-17T03:14:39.888271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:44.283334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904963+0000","last_change":"2024-09-17T03:14:37.924877+0000","last_active":"2024-09-17T03:14:39.904963+0000","last_peered":"2024-09-17T03:14:39.904963+0000","last_clean":"2024-09-17T03:14:39.904963+0000","last_became_active":"2024-09-17T03:14:37.924524+0000","last_became_peered":"2024-09-17T03:14:37.924524+0000","last_unstale":"2024-09-17T03:14:39.904963+0000","last_undegraded":"2024-09-17T03:14:39.904963+0000","last_fullsized":"2024-09-17T03:14:39.904963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:59.046870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904797+0000","last_change":"2024-09-17T03:14:37.934335+0000","last_active":"2024-09-17T03:14:39.904797+0000","last_peered":"2024-09-17T03:14:39.904797+0000","last_clean":"2024-09-17T03:14:39.904797+0000","last_became_active":"2024-09-17T03:14:37.934087+0000","last_became_peered":"2024-09-17T03:14:37.934087+0000","last_unstale":"2024-09-17T03:14:39.904797+0000","last_undegraded":"2024-09-17T03:14:39.904797+0000","last_fullsized":"2024-09-17T03:14:39.904797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:00.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904716+0000","last_change":"2024-09-17T03:14:37.931737+0000","last_active":"2024-09-17T03:14:39.904716+0000","last_peered":"2024-09-17T03:14:39.904716+0000","last_clean":"2024-09-17T03:14:39.904716+0000","last_became_active":"2024-09-17T03:14:37.931268+0000","last_became_peered":"2024-09-17T03:14:37.931268+0000","last_unstale":"2024-09-17T03:14:39.904716+0000","last_undegraded":"2024-09-17T03:14:39.904716+0000","last_fullsized":"2024-09-17T03:14:39.904716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:25.010704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667042+0000","last_change":"2024-09-17T03:14:37.918889+0000","last_active":"2024-09-17T03:14:39.667042+0000","last_peered":"2024-09-17T03:14:39.667042+0000","last_clean":"2024-09-17T03:14:39.667042+0000","last_became_active":"2024-09-17T03:14:37.918600+0000","last_became_peered":"2024-09-17T03:14:37.918600+0000","last_unstale":"2024-09-17T03:14:39.667042+0000","last_undegraded":"2024-09-17T03:14:39.667042+0000","last_fullsized":"2024-09-17T03:14:39.667042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.718131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918713+0000","last_change":"2024-09-17T03:14:37.925187+0000","last_active":"2024-09-17T03:14:38.918713+0000","last_peered":"2024-09-17T03:14:38.918713+0000","last_clean":"2024-09-17T03:14:38.918713+0000","last_became_active":"2024-09-17T03:14:37.921554+0000","last_became_peered":"2024-09-17T03:14:37.921554+0000","last_unstale":"2024-09-17T03:14:38.918713+0000","last_undegraded":"2024-09-17T03:14:38.918713+0000","last_fullsized":"2024-09-17T03:14:38.918713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:00.487725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248111+0000","last_change":"2024-09-17T03:14:37.918971+0000","last_active":"2024-09-17T03:14:40.248111+0000","last_peered":"2024-09-17T03:14:40.248111+0000","last_clean":"2024-09-17T03:14:40.248111+0000","last_became_active":"2024-09-17T03:14:37.918667+0000","last_became_peered":"2024-09-17T03:14:37.918667+0000","last_unstale":"2024-09-17T03:14:40.248111+0000","last_undegraded":"2024-09-17T03:14:40.248111+0000","last_fullsized":"2024-09-17T03:14:40.248111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:39.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919882+0000","last_change":"2024-09-17T03:14:37.914820+0000","last_active":"2024-09-17T03:14:38.919882+0000","last_peered":"2024-09-17T03:14:38.919882+0000","last_clean":"2024-09-17T03:14:38.919882+0000","last_became_active":"2024-09-17T03:14:37.914525+0000","last_became_peered":"2024-09-17T03:14:37.914525+0000","last_unstale":"2024-09-17T03:14:38.919882+0000","last_undegraded":"2024-09-17T03:14:38.919882+0000","last_fullsized":"2024-09-17T03:14:38.919882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:02.988944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905289+0000","last_change":"2024-09-17T03:14:37.937272+0000","last_active":"2024-09-17T03:14:39.905289+0000","last_peered":"2024-09-17T03:14:39.905289+0000","last_clean":"2024-09-17T03:14:39.905289+0000","last_became_active":"2024-09-17T03:14:37.929899+0000","last_became_peered":"2024-09-17T03:14:37.929899+0000","last_unstale":"2024-09-17T03:14:39.905289+0000","last_undegraded":"2024-09-17T03:14:39.905289+0000","last_fullsized":"2024-09-17T03:14:39.905289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:45.514112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916045+0000","last_change":"2024-09-17T03:14:37.908890+0000","last_active":"2024-09-17T03:14:38.916045+0000","last_peered":"2024-09-17T03:14:38.916045+0000","last_clean":"2024-09-17T03:14:38.916045+0000","last_became_active":"2024-09-17T03:14:37.908582+0000","last_became_peered":"2024-09-17T03:14:37.908582+0000","last_unstale":"2024-09-17T03:14:38.916045+0000","last_undegraded":"2024-09-17T03:14:38.916045+0000","last_fullsized":"2024-09-17T03:14:38.916045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:46.004166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667433+0000","last_change":"2024-09-17T03:14:37.918649+0000","last_active":"2024-09-17T03:14:39.667433+0000","last_peered":"2024-09-17T03:14:39.667433+0000","last_clean":"2024-09-17T03:14:39.667433+0000","last_became_active":"2024-09-17T03:14:37.914911+0000","last_became_peered":"2024-09-17T03:14:37.914911+0000","last_unstale":"2024-09-17T03:14:39.667433+0000","last_undegraded":"2024-09-17T03:14:39.667433+0000","last_fullsized":"2024-09-17T03:14:39.667433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:43.998632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667101+0000","last_change":"2024-09-17T03:14:37.932532+0000","last_active":"2024-09-17T03:14:39.667101+0000","last_peered":"2024-09-17T03:14:39.667101+0000","last_clean":"2024-09-17T03:14:39.667101+0000","last_became_active":"2024-09-17T03:14:37.931864+0000","last_became_peered":"2024-09-17T03:14:37.931864+0000","last_unstale":"2024-09-17T03:14:39.667101+0000","last_undegraded":"2024-09-17T03:14:39.667101+0000","last_fullsized":"2024-09-17T03:14:39.667101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:45.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915497+0000","last_change":"2024-09-17T03:14:37.910258+0000","last_active":"2024-09-17T03:14:38.915497+0000","last_peered":"2024-09-17T03:14:38.915497+0000","last_clean":"2024-09-17T03:14:38.915497+0000","last_became_active":"2024-09-17T03:14:37.909949+0000","last_became_peered":"2024-09-17T03:14:37.909949+0000","last_unstale":"2024-09-17T03:14:38.915497+0000","last_undegraded":"2024-09-17T03:14:38.915497+0000","last_fullsized":"2024-09-17T03:14:38.915497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:23.024922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918936+0000","last_change":"2024-09-17T03:14:37.929536+0000","last_active":"2024-09-17T03:14:38.918936+0000","last_peered":"2024-09-17T03:14:38.918936+0000","last_clean":"2024-09-17T03:14:38.918936+0000","last_became_active":"2024-09-17T03:14:37.924822+0000","last_became_peered":"2024-09-17T03:14:37.924822+0000","last_unstale":"2024-09-17T03:14:38.918936+0000","last_undegraded":"2024-09-17T03:14:38.918936+0000","last_fullsized":"2024-09-17T03:14:38.918936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:00.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667368+0000","last_change":"2024-09-17T03:14:37.922333+0000","last_active":"2024-09-17T03:14:39.667368+0000","last_peered":"2024-09-17T03:14:39.667368+0000","last_clean":"2024-09-17T03:14:39.667368+0000","last_became_active":"2024-09-17T03:14:37.919774+0000","last_became_peered":"2024-09-17T03:14:37.919774+0000","last_unstale":"2024-09-17T03:14:39.667368+0000","last_undegraded":"2024-09-17T03:14:39.667368+0000","last_fullsized":"2024-09-17T03:14:39.667368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:29.964627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248024+0000","last_change":"2024-09-17T03:14:36.919459+0000","last_active":"2024-09-17T03:14:40.248024+0000","last_peered":"2024-09-17T03:14:40.248024+0000","last_clean":"2024-09-17T03:14:40.248024+0000","last_became_active":"2024-09-17T03:14:36.919157+0000","last_became_peered":"2024-09-17T03:14:36.919157+0000","last_unstale":"2024-09-17T03:14:40.248024+0000","last_undegraded":"2024-09-17T03:14:40.248024+0000","last_fullsized":"2024-09-17T03:14:40.248024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:03.170093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.926962+0000","last_change":"2024-09-17T03:14:37.912463+0000","last_active":"2024-09-17T03:14:37.926962+0000","last_peered":"2024-09-17T03:14:37.926962+0000","last_clean":"2024-09-17T03:14:37.926962+0000","last_became_active":"2024-09-17T03:14:37.912103+0000","last_became_peered":"2024-09-17T03:14:37.912103+0000","last_unstale":"2024-09-17T03:14:37.926962+0000","last_undegraded":"2024-09-17T03:14:37.926962+0000","last_fullsized":"2024-09-17T03:14:37.926962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.944223+0000","last_change":"2024-09-17T03:14:36.914189+0000","last_active":"2024-09-17T03:14:37.944223+0000","last_peered":"2024-09-17T03:14:37.944223+0000","last_clean":"2024-09-17T03:14:37.944223+0000","last_became_active":"2024-09-17T03:14:36.913759+0000","last_became_peered":"2024-09-17T03:14:36.913759+0000","last_unstale":"2024-09-17T03:14:37.944223+0000","last_undegraded":"2024-09-17T03:14:37.944223+0000","last_fullsized":"2024-09-17T03:14:37.944223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667500+0000","last_change":"2024-09-17T03:14:37.921729+0000","last_active":"2024-09-17T03:14:39.667500+0000","last_peered":"2024-09-17T03:14:39.667500+0000","last_clean":"2024-09-17T03:14:39.667500+0000","last_became_active":"2024-09-17T03:14:37.921290+0000","last_became_peered":"2024-09-17T03:14:37.921290+0000","last_unstale":"2024-09-17T03:14:39.667500+0000","last_undegraded":"2024-09-17T03:14:39.667500+0000","last_fullsized":"2024-09-17T03:14:39.667500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:22.375459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919802+0000","last_change":"2024-09-17T03:14:36.915336+0000","last_active":"2024-09-17T03:14:38.919802+0000","last_peered":"2024-09-17T03:14:38.919802+0000","last_clean":"2024-09-17T03:14:38.919802+0000","last_became_active":"2024-09-17T03:14:36.914976+0000","last_became_peered":"2024-09-17T03:14:36.914976+0000","last_unstale":"2024-09-17T03:14:38.919802+0000","last_undegraded":"2024-09-17T03:14:38.919802+0000","last_fullsized":"2024-09-17T03:14:38.919802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:43.593532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.930975+0000","last_change":"2024-09-17T03:14:37.929582+0000","last_active":"2024-09-17T03:14:37.930975+0000","last_peered":"2024-09-17T03:14:37.930975+0000","last_clean":"2024-09-17T03:14:37.930975+0000","last_became_active":"2024-09-17T03:14:37.929244+0000","last_became_peered":"2024-09-17T03:14:37.929244+0000","last_unstale":"2024-09-17T03:14:37.930975+0000","last_undegraded":"2024-09-17T03:14:37.930975+0000","last_fullsized":"2024-09-17T03:14:37.930975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:57.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247778+0000","last_change":"2024-09-17T03:14:36.923785+0000","last_active":"2024-09-17T03:14:40.247778+0000","last_peered":"2024-09-17T03:14:40.247778+0000","last_clean":"2024-09-17T03:14:40.247778+0000","last_became_active":"2024-09-17T03:14:36.923407+0000","last_became_peered":"2024-09-17T03:14:36.923407+0000","last_unstale":"2024-09-17T03:14:40.247778+0000","last_undegraded":"2024-09-17T03:14:40.247778+0000","last_fullsized":"2024-09-17T03:14:40.247778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:19.669130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919184+0000","last_change":"2024-09-17T03:14:37.935225+0000","last_active":"2024-09-17T03:14:38.919184+0000","last_peered":"2024-09-17T03:14:38.919184+0000","last_clean":"2024-09-17T03:14:38.919184+0000","last_became_active":"2024-09-17T03:14:37.934527+0000","last_became_peered":"2024-09-17T03:14:37.934527+0000","last_unstale":"2024-09-17T03:14:38.919184+0000","last_undegraded":"2024-09-17T03:14:38.919184+0000","last_fullsized":"2024-09-17T03:14:38.919184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:00.004933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247756+0000","last_change":"2024-09-17T03:14:36.918145+0000","last_active":"2024-09-17T03:14:40.247756+0000","last_peered":"2024-09-17T03:14:40.247756+0000","last_clean":"2024-09-17T03:14:40.247756+0000","last_became_active":"2024-09-17T03:14:36.917775+0000","last_became_peered":"2024-09-17T03:14:36.917775+0000","last_unstale":"2024-09-17T03:14:40.247756+0000","last_undegraded":"2024-09-17T03:14:40.247756+0000","last_fullsized":"2024-09-17T03:14:40.247756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:57.115028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904752+0000","last_change":"2024-09-17T03:14:37.928437+0000","last_active":"2024-09-17T03:14:39.904752+0000","last_peered":"2024-09-17T03:14:39.904752+0000","last_clean":"2024-09-17T03:14:39.904752+0000","last_became_active":"2024-09-17T03:14:37.928129+0000","last_became_peered":"2024-09-17T03:14:37.928129+0000","last_unstale":"2024-09-17T03:14:39.904752+0000","last_undegraded":"2024-09-17T03:14:39.904752+0000","last_fullsized":"2024-09-17T03:14:39.904752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:38.645776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915486+0000","last_change":"2024-09-17T03:14:36.919059+0000","last_active":"2024-09-17T03:14:38.915486+0000","last_peered":"2024-09-17T03:14:38.915486+0000","last_clean":"2024-09-17T03:14:38.915486+0000","last_became_active":"2024-09-17T03:14:36.918746+0000","last_became_peered":"2024-09-17T03:14:36.918746+0000","last_unstale":"2024-09-17T03:14:38.915486+0000","last_undegraded":"2024-09-17T03:14:38.915486+0000","last_fullsized":"2024-09-17T03:14:38.915486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:59.611828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667169+0000","last_change":"2024-09-17T03:14:37.932207+0000","last_active":"2024-09-17T03:14:39.667169+0000","last_peered":"2024-09-17T03:14:39.667169+0000","last_clean":"2024-09-17T03:14:39.667169+0000","last_became_active":"2024-09-17T03:14:37.931501+0000","last_became_peered":"2024-09-17T03:14:37.931501+0000","last_unstale":"2024-09-17T03:14:39.667169+0000","last_undegraded":"2024-09-17T03:14:39.667169+0000","last_fullsized":"2024-09-17T03:14:39.667169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:11.603444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917655+0000","last_change":"2024-09-17T03:14:36.925978+0000","last_active":"2024-09-17T03:14:38.917655+0000","last_peered":"2024-09-17T03:14:38.917655+0000","last_clean":"2024-09-17T03:14:38.917655+0000","last_became_active":"2024-09-17T03:14:36.925675+0000","last_became_peered":"2024-09-17T03:14:36.925675+0000","last_unstale":"2024-09-17T03:14:38.917655+0000","last_undegraded":"2024-09-17T03:14:38.917655+0000","last_fullsized":"2024-09-17T03:14:38.917655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:51.069808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.928836+0000","last_change":"2024-09-17T03:14:37.927188+0000","last_active":"2024-09-17T03:14:37.928836+0000","last_peered":"2024-09-17T03:14:37.928836+0000","last_clean":"2024-09-17T03:14:37.928836+0000","last_became_active":"2024-09-17T03:14:37.923498+0000","last_became_peered":"2024-09-17T03:14:37.923498+0000","last_unstale":"2024-09-17T03:14:37.928836+0000","last_undegraded":"2024-09-17T03:14:37.928836+0000","last_fullsized":"2024-09-17T03:14:37.928836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:23.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915284+0000","last_change":"2024-09-17T03:14:36.912696+0000","last_active":"2024-09-17T03:14:38.915284+0000","last_peered":"2024-09-17T03:14:38.915284+0000","last_clean":"2024-09-17T03:14:38.915284+0000","last_became_active":"2024-09-17T03:14:36.912364+0000","last_became_peered":"2024-09-17T03:14:36.912364+0000","last_unstale":"2024-09-17T03:14:38.915284+0000","last_undegraded":"2024-09-17T03:14:38.915284+0000","last_fullsized":"2024-09-17T03:14:38.915284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:41.054162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919396+0000","last_change":"2024-09-17T03:14:37.925010+0000","last_active":"2024-09-17T03:14:38.919396+0000","last_peered":"2024-09-17T03:14:38.919396+0000","last_clean":"2024-09-17T03:14:38.919396+0000","last_became_active":"2024-09-17T03:14:37.924289+0000","last_became_peered":"2024-09-17T03:14:37.924289+0000","last_unstale":"2024-09-17T03:14:38.919396+0000","last_undegraded":"2024-09-17T03:14:38.919396+0000","last_fullsized":"2024-09-17T03:14:38.919396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.128576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.920023+0000","last_change":"2024-09-17T03:14:36.918393+0000","last_active":"2024-09-17T03:14:38.920023+0000","last_peered":"2024-09-17T03:14:38.920023+0000","last_clean":"2024-09-17T03:14:38.920023+0000","last_became_active":"2024-09-17T03:14:36.918003+0000","last_became_peered":"2024-09-17T03:14:36.918003+0000","last_unstale":"2024-09-17T03:14:38.920023+0000","last_undegraded":"2024-09-17T03:14:38.920023+0000","last_fullsized":"2024-09-17T03:14:38.920023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:45.151063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248033+0000","last_change":"2024-09-17T03:14:37.924828+0000","last_active":"2024-09-17T03:14:40.248033+0000","last_peered":"2024-09-17T03:14:40.248033+0000","last_clean":"2024-09-17T03:14:40.248033+0000","last_became_active":"2024-09-17T03:14:37.917570+0000","last_became_peered":"2024-09-17T03:14:37.917570+0000","last_unstale":"2024-09-17T03:14:40.248033+0000","last_undegraded":"2024-09-17T03:14:40.248033+0000","last_fullsized":"2024-09-17T03:14:40.248033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:27.498618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667189+0000","last_change":"2024-09-17T03:14:36.918369+0000","last_active":"2024-09-17T03:14:39.667189+0000","last_peered":"2024-09-17T03:14:39.667189+0000","last_clean":"2024-09-17T03:14:39.667189+0000","last_became_active":"2024-09-17T03:14:36.918103+0000","last_became_peered":"2024-09-17T03:14:36.918103+0000","last_unstale":"2024-09-17T03:14:39.667189+0000","last_undegraded":"2024-09-17T03:14:39.667189+0000","last_fullsized":"2024-09-17T03:14:39.667189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:29.198060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919959+0000","last_change":"2024-09-17T03:14:37.919968+0000","last_active":"2024-09-17T03:14:38.919959+0000","last_peered":"2024-09-17T03:14:38.919959+0000","last_clean":"2024-09-17T03:14:38.919959+0000","last_became_active":"2024-09-17T03:14:37.919606+0000","last_became_peered":"2024-09-17T03:14:37.919606+0000","last_unstale":"2024-09-17T03:14:38.919959+0000","last_undegraded":"2024-09-17T03:14:38.919959+0000","last_fullsized":"2024-09-17T03:14:38.919959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:29.688951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667040+0000","last_change":"2024-09-17T03:14:36.922737+0000","last_active":"2024-09-17T03:14:39.667040+0000","last_peered":"2024-09-17T03:14:39.667040+0000","last_clean":"2024-09-17T03:14:39.667040+0000","last_became_active":"2024-09-17T03:14:36.922473+0000","last_became_peered":"2024-09-17T03:14:36.922473+0000","last_unstale":"2024-09-17T03:14:39.667040+0000","last_undegraded":"2024-09-17T03:14:39.667040+0000","last_fullsized":"2024-09-17T03:14:39.667040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:01.501489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916734+0000","last_change":"2024-09-17T03:14:37.922491+0000","last_active":"2024-09-17T03:14:38.916734+0000","last_peered":"2024-09-17T03:14:38.916734+0000","last_clean":"2024-09-17T03:14:38.916734+0000","last_became_active":"2024-09-17T03:14:37.922210+0000","last_became_peered":"2024-09-17T03:14:37.922210+0000","last_unstale":"2024-09-17T03:14:38.916734+0000","last_undegraded":"2024-09-17T03:14:38.916734+0000","last_fullsized":"2024-09-17T03:14:38.916734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:45.166992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919354+0000","last_change":"2024-09-17T03:14:36.920649+0000","last_active":"2024-09-17T03:14:38.919354+0000","last_peered":"2024-09-17T03:14:38.919354+0000","last_clean":"2024-09-17T03:14:38.919354+0000","last_became_active":"2024-09-17T03:14:36.920336+0000","last_became_peered":"2024-09-17T03:14:36.920336+0000","last_unstale":"2024-09-17T03:14:38.919354+0000","last_undegraded":"2024-09-17T03:14:38.919354+0000","last_fullsized":"2024-09-17T03:14:38.919354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:40.796766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919439+0000","last_change":"2024-09-17T03:14:37.925567+0000","last_active":"2024-09-17T03:14:38.919439+0000","last_peered":"2024-09-17T03:14:38.919439+0000","last_clean":"2024-09-17T03:14:38.919439+0000","last_became_active":"2024-09-17T03:14:37.924189+0000","last_became_peered":"2024-09-17T03:14:37.924189+0000","last_unstale":"2024-09-17T03:14:38.919439+0000","last_undegraded":"2024-09-17T03:14:38.919439+0000","last_fullsized":"2024-09-17T03:14:38.919439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:27.639246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918927+0000","last_change":"2024-09-17T03:14:36.915616+0000","last_active":"2024-09-17T03:14:38.918927+0000","last_peered":"2024-09-17T03:14:38.918927+0000","last_clean":"2024-09-17T03:14:38.918927+0000","last_became_active":"2024-09-17T03:14:36.915341+0000","last_became_peered":"2024-09-17T03:14:36.915341+0000","last_unstale":"2024-09-17T03:14:38.918927+0000","last_undegraded":"2024-09-17T03:14:38.918927+0000","last_fullsized":"2024-09-17T03:14:38.918927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:13.253503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.920702+0000","last_change":"2024-09-17T03:14:37.913219+0000","last_active":"2024-09-17T03:14:37.920702+0000","last_peered":"2024-09-17T03:14:37.920702+0000","last_clean":"2024-09-17T03:14:37.920702+0000","last_became_active":"2024-09-17T03:14:37.912848+0000","last_became_peered":"2024-09-17T03:14:37.912848+0000","last_unstale":"2024-09-17T03:14:37.920702+0000","last_undegraded":"2024-09-17T03:14:37.920702+0000","last_fullsized":"2024-09-17T03:14:37.920702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.908019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.901011+0000","last_change":"2024-09-17T03:14:36.906986+0000","last_active":"2024-09-17T03:14:37.901011+0000","last_peered":"2024-09-17T03:14:37.901011+0000","last_clean":"2024-09-17T03:14:37.901011+0000","last_became_active":"2024-09-17T03:14:36.906610+0000","last_became_peered":"2024-09-17T03:14:36.906610+0000","last_unstale":"2024-09-17T03:14:37.901011+0000","last_undegraded":"2024-09-17T03:14:37.901011+0000","last_fullsized":"2024-09-17T03:14:37.901011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:06.494486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905169+0000","last_change":"2024-09-17T03:14:37.924573+0000","last_active":"2024-09-17T03:14:39.905169+0000","last_peered":"2024-09-17T03:14:39.905169+0000","last_clean":"2024-09-17T03:14:39.905169+0000","last_became_active":"2024-09-17T03:14:37.917759+0000","last_became_peered":"2024-09-17T03:14:37.917759+0000","last_unstale":"2024-09-17T03:14:39.905169+0000","last_undegraded":"2024-09-17T03:14:39.905169+0000","last_fullsized":"2024-09-17T03:14:39.905169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:28.247627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667188+0000","last_change":"2024-09-17T03:14:36.924180+0000","last_active":"2024-09-17T03:14:39.667188+0000","last_peered":"2024-09-17T03:14:39.667188+0000","last_clean":"2024-09-17T03:14:39.667188+0000","last_became_active":"2024-09-17T03:14:36.923781+0000","last_became_peered":"2024-09-17T03:14:36.923781+0000","last_unstale":"2024-09-17T03:14:39.667188+0000","last_undegraded":"2024-09-17T03:14:39.667188+0000","last_fullsized":"2024-09-17T03:14:39.667188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:44.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917971+0000","last_change":"2024-09-17T03:14:37.931956+0000","last_active":"2024-09-17T03:14:38.917971+0000","last_peered":"2024-09-17T03:14:38.917971+0000","last_clean":"2024-09-17T03:14:38.917971+0000","last_became_active":"2024-09-17T03:14:37.931464+0000","last_became_peered":"2024-09-17T03:14:37.931464+0000","last_unstale":"2024-09-17T03:14:38.917971+0000","last_undegraded":"2024-09-17T03:14:38.917971+0000","last_fullsized":"2024-09-17T03:14:38.917971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:03.949546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247727+0000","last_change":"2024-09-17T03:14:36.921381+0000","last_active":"2024-09-17T03:14:40.247727+0000","last_peered":"2024-09-17T03:14:40.247727+0000","last_clean":"2024-09-17T03:14:40.247727+0000","last_became_active":"2024-09-17T03:14:36.921084+0000","last_became_peered":"2024-09-17T03:14:36.921084+0000","last_unstale":"2024-09-17T03:14:40.247727+0000","last_undegraded":"2024-09-17T03:14:40.247727+0000","last_fullsized":"2024-09-17T03:14:40.247727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923307+0000","last_change":"2024-09-17T03:14:37.916083+0000","last_active":"2024-09-17T03:14:37.923307+0000","last_peered":"2024-09-17T03:14:37.923307+0000","last_clean":"2024-09-17T03:14:37.923307+0000","last_became_active":"2024-09-17T03:14:37.912339+0000","last_became_peered":"2024-09-17T03:14:37.912339+0000","last_unstale":"2024-09-17T03:14:37.923307+0000","last_undegraded":"2024-09-17T03:14:37.923307+0000","last_fullsized":"2024-09-17T03:14:37.923307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:09.389752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916628+0000","last_change":"2024-09-17T03:14:36.921428+0000","last_active":"2024-09-17T03:14:38.916628+0000","last_peered":"2024-09-17T03:14:38.916628+0000","last_clean":"2024-09-17T03:14:38.916628+0000","last_became_active":"2024-09-17T03:14:36.921123+0000","last_became_peered":"2024-09-17T03:14:36.921123+0000","last_unstale":"2024-09-17T03:14:38.916628+0000","last_undegraded":"2024-09-17T03:14:38.916628+0000","last_fullsized":"2024-09-17T03:14:38.916628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.979021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916162+0000","last_change":"2024-09-17T03:14:37.909600+0000","last_active":"2024-09-17T03:14:38.916162+0000","last_peered":"2024-09-17T03:14:38.916162+0000","last_clean":"2024-09-17T03:14:38.916162+0000","last_became_active":"2024-09-17T03:14:37.909209+0000","last_became_peered":"2024-09-17T03:14:37.909209+0000","last_unstale":"2024-09-17T03:14:38.916162+0000","last_undegraded":"2024-09-17T03:14:38.916162+0000","last_fullsized":"2024-09-17T03:14:38.916162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:28.685662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667330+0000","last_change":"2024-09-17T03:14:36.923058+0000","last_active":"2024-09-17T03:14:39.667330+0000","last_peered":"2024-09-17T03:14:39.667330+0000","last_clean":"2024-09-17T03:14:39.667330+0000","last_became_active":"2024-09-17T03:14:36.922736+0000","last_became_peered":"2024-09-17T03:14:36.922736+0000","last_unstale":"2024-09-17T03:14:39.667330+0000","last_undegraded":"2024-09-17T03:14:39.667330+0000","last_fullsized":"2024-09-17T03:14:39.667330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:52.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916722+0000","last_change":"2024-09-17T03:14:37.910283+0000","last_active":"2024-09-17T03:14:38.916722+0000","last_peered":"2024-09-17T03:14:38.916722+0000","last_clean":"2024-09-17T03:14:38.916722+0000","last_became_active":"2024-09-17T03:14:37.909976+0000","last_became_peered":"2024-09-17T03:14:37.909976+0000","last_unstale":"2024-09-17T03:14:38.916722+0000","last_undegraded":"2024-09-17T03:14:38.916722+0000","last_fullsized":"2024-09-17T03:14:38.916722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:59.534040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917812+0000","last_change":"2024-09-17T03:14:36.922118+0000","last_active":"2024-09-17T03:14:38.917812+0000","last_peered":"2024-09-17T03:14:38.917812+0000","last_clean":"2024-09-17T03:14:38.917812+0000","last_became_active":"2024-09-17T03:14:36.921777+0000","last_became_peered":"2024-09-17T03:14:36.921777+0000","last_unstale":"2024-09-17T03:14:38.917812+0000","last_undegraded":"2024-09-17T03:14:38.917812+0000","last_fullsized":"2024-09-17T03:14:38.917812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:58.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888423+0000","last_change":"2024-09-17T03:14:37.911362+0000","last_active":"2024-09-17T03:14:39.888423+0000","last_peered":"2024-09-17T03:14:39.888423+0000","last_clean":"2024-09-17T03:14:39.888423+0000","last_became_active":"2024-09-17T03:14:37.911051+0000","last_became_peered":"2024-09-17T03:14:37.911051+0000","last_unstale":"2024-09-17T03:14:39.888423+0000","last_undegraded":"2024-09-17T03:14:39.888423+0000","last_fullsized":"2024-09-17T03:14:39.888423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888029+0000","last_change":"2024-09-17T03:14:36.919877+0000","last_active":"2024-09-17T03:14:39.888029+0000","last_peered":"2024-09-17T03:14:39.888029+0000","last_clean":"2024-09-17T03:14:39.888029+0000","last_became_active":"2024-09-17T03:14:36.919462+0000","last_became_peered":"2024-09-17T03:14:36.919462+0000","last_unstale":"2024-09-17T03:14:39.888029+0000","last_undegraded":"2024-09-17T03:14:39.888029+0000","last_fullsized":"2024-09-17T03:14:39.888029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:30.380746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667035+0000","last_change":"2024-09-17T03:14:37.915400+0000","last_active":"2024-09-17T03:14:39.667035+0000","last_peered":"2024-09-17T03:14:39.667035+0000","last_clean":"2024-09-17T03:14:39.667035+0000","last_became_active":"2024-09-17T03:14:37.914731+0000","last_became_peered":"2024-09-17T03:14:37.914731+0000","last_unstale":"2024-09-17T03:14:39.667035+0000","last_undegraded":"2024-09-17T03:14:39.667035+0000","last_fullsized":"2024-09-17T03:14:39.667035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:12.610229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.887984+0000","last_change":"2024-09-17T03:14:36.917828+0000","last_active":"2024-09-17T03:14:39.887984+0000","last_peered":"2024-09-17T03:14:39.887984+0000","last_clean":"2024-09-17T03:14:39.887984+0000","last_became_active":"2024-09-17T03:14:36.917563+0000","last_became_peered":"2024-09-17T03:14:36.917563+0000","last_unstale":"2024-09-17T03:14:39.887984+0000","last_undegraded":"2024-09-17T03:14:39.887984+0000","last_fullsized":"2024-09-17T03:14:39.887984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917584+0000","last_change":"2024-09-17T03:14:37.912226+0000","last_active":"2024-09-17T03:14:38.917584+0000","last_peered":"2024-09-17T03:14:38.917584+0000","last_clean":"2024-09-17T03:14:38.917584+0000","last_became_active":"2024-09-17T03:14:37.911946+0000","last_became_peered":"2024-09-17T03:14:37.911946+0000","last_unstale":"2024-09-17T03:14:38.917584+0000","last_undegraded":"2024-09-17T03:14:38.917584+0000","last_fullsized":"2024-09-17T03:14:38.917584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:48.422868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.902420+0000","last_change":"2024-09-17T03:14:36.911465+0000","last_active":"2024-09-17T03:14:37.902420+0000","last_peered":"2024-09-17T03:14:37.902420+0000","last_clean":"2024-09-17T03:14:37.902420+0000","last_became_active":"2024-09-17T03:14:36.910962+0000","last_became_peered":"2024-09-17T03:14:36.910962+0000","last_unstale":"2024-09-17T03:14:37.902420+0000","last_undegraded":"2024-09-17T03:14:37.902420+0000","last_fullsized":"2024-09-17T03:14:37.902420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.148718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904731+0000","last_change":"2024-09-17T03:14:37.931537+0000","last_active":"2024-09-17T03:14:39.904731+0000","last_peered":"2024-09-17T03:14:39.904731+0000","last_clean":"2024-09-17T03:14:39.904731+0000","last_became_active":"2024-09-17T03:14:37.930870+0000","last_became_peered":"2024-09-17T03:14:37.930870+0000","last_unstale":"2024-09-17T03:14:39.904731+0000","last_undegraded":"2024-09-17T03:14:39.904731+0000","last_fullsized":"2024-09-17T03:14:39.904731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915570+0000","last_change":"2024-09-17T03:14:36.913626+0000","last_active":"2024-09-17T03:14:38.915570+0000","last_peered":"2024-09-17T03:14:38.915570+0000","last_clean":"2024-09-17T03:14:38.915570+0000","last_became_active":"2024-09-17T03:14:36.912768+0000","last_became_peered":"2024-09-17T03:14:36.912768+0000","last_unstale":"2024-09-17T03:14:38.915570+0000","last_undegraded":"2024-09-17T03:14:38.915570+0000","last_fullsized":"2024-09-17T03:14:38.915570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.517940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919003+0000","last_change":"2024-09-17T03:14:37.919753+0000","last_active":"2024-09-17T03:14:38.919003+0000","last_peered":"2024-09-17T03:14:38.919003+0000","last_clean":"2024-09-17T03:14:38.919003+0000","last_became_active":"2024-09-17T03:14:37.919458+0000","last_became_peered":"2024-09-17T03:14:37.919458+0000","last_unstale":"2024-09-17T03:14:38.919003+0000","last_undegraded":"2024-09-17T03:14:38.919003+0000","last_fullsized":"2024-09-17T03:14:38.919003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:00.443720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.900455+0000","last_change":"2024-09-17T03:14:36.924434+0000","last_active":"2024-09-17T03:14:37.900455+0000","last_peered":"2024-09-17T03:14:37.900455+0000","last_clean":"2024-09-17T03:14:37.900455+0000","last_became_active":"2024-09-17T03:14:36.922875+0000","last_became_peered":"2024-09-17T03:14:36.922875+0000","last_unstale":"2024-09-17T03:14:37.900455+0000","last_undegraded":"2024-09-17T03:14:37.900455+0000","last_fullsized":"2024-09-17T03:14:37.900455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:26.793869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918123+0000","last_change":"2024-09-17T03:14:37.930593+0000","last_active":"2024-09-17T03:14:38.918123+0000","last_peered":"2024-09-17T03:14:38.918123+0000","last_clean":"2024-09-17T03:14:38.918123+0000","last_became_active":"2024-09-17T03:14:37.930249+0000","last_became_peered":"2024-09-17T03:14:37.930249+0000","last_unstale":"2024-09-17T03:14:38.918123+0000","last_undegraded":"2024-09-17T03:14:38.918123+0000","last_fullsized":"2024-09-17T03:14:38.918123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.975256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667593+0000","last_change":"2024-09-17T03:14:36.915113+0000","last_active":"2024-09-17T03:14:39.667593+0000","last_peered":"2024-09-17T03:14:39.667593+0000","last_clean":"2024-09-17T03:14:39.667593+0000","last_became_active":"2024-09-17T03:14:36.914812+0000","last_became_peered":"2024-09-17T03:14:36.914812+0000","last_unstale":"2024-09-17T03:14:39.667593+0000","last_undegraded":"2024-09-17T03:14:39.667593+0000","last_fullsized":"2024-09-17T03:14:39.667593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.229040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905311+0000","last_change":"2024-09-17T03:14:37.931554+0000","last_active":"2024-09-17T03:14:39.905311+0000","last_peered":"2024-09-17T03:14:39.905311+0000","last_clean":"2024-09-17T03:14:39.905311+0000","last_became_active":"2024-09-17T03:14:37.930825+0000","last_became_peered":"2024-09-17T03:14:37.930825+0000","last_unstale":"2024-09-17T03:14:39.905311+0000","last_undegraded":"2024-09-17T03:14:39.905311+0000","last_fullsized":"2024-09-17T03:14:39.905311+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:06.238924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917956+0000","last_change":"2024-09-17T03:14:36.922204+0000","last_active":"2024-09-17T03:14:38.917956+0000","last_peered":"2024-09-17T03:14:38.917956+0000","last_clean":"2024-09-17T03:14:38.917956+0000","last_became_active":"2024-09-17T03:14:36.921846+0000","last_became_peered":"2024-09-17T03:14:36.921846+0000","last_unstale":"2024-09-17T03:14:38.917956+0000","last_undegraded":"2024-09-17T03:14:38.917956+0000","last_fullsized":"2024-09-17T03:14:38.917956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:35.900648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888313+0000","last_change":"2024-09-17T03:14:37.924380+0000","last_active":"2024-09-17T03:14:39.888313+0000","last_peered":"2024-09-17T03:14:39.888313+0000","last_clean":"2024-09-17T03:14:39.888313+0000","last_became_active":"2024-09-17T03:14:37.924111+0000","last_became_peered":"2024-09-17T03:14:37.924111+0000","last_unstale":"2024-09-17T03:14:39.888313+0000","last_undegraded":"2024-09-17T03:14:39.888313+0000","last_fullsized":"2024-09-17T03:14:39.888313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:26.021459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917939+0000","last_change":"2024-09-17T03:14:36.921890+0000","last_active":"2024-09-17T03:14:38.917939+0000","last_peered":"2024-09-17T03:14:38.917939+0000","last_clean":"2024-09-17T03:14:38.917939+0000","last_became_active":"2024-09-17T03:14:36.921468+0000","last_became_peered":"2024-09-17T03:14:36.921468+0000","last_unstale":"2024-09-17T03:14:38.917939+0000","last_undegraded":"2024-09-17T03:14:38.917939+0000","last_fullsized":"2024-09-17T03:14:38.917939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917497+0000","last_change":"2024-09-17T03:14:37.938088+0000","last_active":"2024-09-17T03:14:38.917497+0000","last_peered":"2024-09-17T03:14:38.917497+0000","last_clean":"2024-09-17T03:14:38.917497+0000","last_became_active":"2024-09-17T03:14:37.937723+0000","last_became_peered":"2024-09-17T03:14:37.937723+0000","last_unstale":"2024-09-17T03:14:38.917497+0000","last_undegraded":"2024-09-17T03:14:38.917497+0000","last_fullsized":"2024-09-17T03:14:38.917497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:35.741738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919097+0000","last_change":"2024-09-17T03:14:36.917011+0000","last_active":"2024-09-17T03:14:38.919097+0000","last_peered":"2024-09-17T03:14:38.919097+0000","last_clean":"2024-09-17T03:14:38.919097+0000","last_became_active":"2024-09-17T03:14:36.916298+0000","last_became_peered":"2024-09-17T03:14:36.916298+0000","last_unstale":"2024-09-17T03:14:38.919097+0000","last_undegraded":"2024-09-17T03:14:38.919097+0000","last_fullsized":"2024-09-17T03:14:38.919097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:26.488733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.929687+0000","last_change":"2024-09-17T03:14:37.928215+0000","last_active":"2024-09-17T03:14:37.929687+0000","last_peered":"2024-09-17T03:14:37.929687+0000","last_clean":"2024-09-17T03:14:37.929687+0000","last_became_active":"2024-09-17T03:14:37.927665+0000","last_became_peered":"2024-09-17T03:14:37.927665+0000","last_unstale":"2024-09-17T03:14:37.929687+0000","last_undegraded":"2024-09-17T03:14:37.929687+0000","last_fullsized":"2024-09-17T03:14:37.929687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:45.439704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904813+0000","last_change":"2024-09-17T03:14:36.922835+0000","last_active":"2024-09-17T03:14:39.904813+0000","last_peered":"2024-09-17T03:14:39.904813+0000","last_clean":"2024-09-17T03:14:39.904813+0000","last_became_active":"2024-09-17T03:14:36.922217+0000","last_became_peered":"2024-09-17T03:14:36.922217+0000","last_unstale":"2024-09-17T03:14:39.904813+0000","last_undegraded":"2024-09-17T03:14:39.904813+0000","last_fullsized":"2024-09-17T03:14:39.904813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:59.651903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667640+0000","last_change":"2024-09-17T03:14:37.916054+0000","last_active":"2024-09-17T03:14:39.667640+0000","last_peered":"2024-09-17T03:14:39.667640+0000","last_clean":"2024-09-17T03:14:39.667640+0000","last_became_active":"2024-09-17T03:14:37.915360+0000","last_became_peered":"2024-09-17T03:14:37.915360+0000","last_unstale":"2024-09-17T03:14:39.667640+0000","last_undegraded":"2024-09-17T03:14:39.667640+0000","last_fullsized":"2024-09-17T03:14:39.667640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:12.876720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667264+0000","last_change":"2024-09-17T03:14:36.915925+0000","last_active":"2024-09-17T03:14:39.667264+0000","last_peered":"2024-09-17T03:14:39.667264+0000","last_clean":"2024-09-17T03:14:39.667264+0000","last_became_active":"2024-09-17T03:14:36.914802+0000","last_became_peered":"2024-09-17T03:14:36.914802+0000","last_unstale":"2024-09-17T03:14:39.667264+0000","last_undegraded":"2024-09-17T03:14:39.667264+0000","last_fullsized":"2024-09-17T03:14:39.667264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:55.918240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905091+0000","last_change":"2024-09-17T03:14:37.916882+0000","last_active":"2024-09-17T03:14:39.905091+0000","last_peered":"2024-09-17T03:14:39.905091+0000","last_clean":"2024-09-17T03:14:39.905091+0000","last_became_active":"2024-09-17T03:14:37.916570+0000","last_became_peered":"2024-09-17T03:14:37.916570+0000","last_unstale":"2024-09-17T03:14:39.905091+0000","last_undegraded":"2024-09-17T03:14:39.905091+0000","last_fullsized":"2024-09-17T03:14:39.905091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919520+0000","last_change":"2024-09-17T03:14:36.918082+0000","last_active":"2024-09-17T03:14:38.919520+0000","last_peered":"2024-09-17T03:14:38.919520+0000","last_clean":"2024-09-17T03:14:38.919520+0000","last_became_active":"2024-09-17T03:14:36.917391+0000","last_became_peered":"2024-09-17T03:14:36.917391+0000","last_unstale":"2024-09-17T03:14:38.919520+0000","last_undegraded":"2024-09-17T03:14:38.919520+0000","last_fullsized":"2024-09-17T03:14:38.919520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667521+0000","last_change":"2024-09-17T03:14:37.937637+0000","last_active":"2024-09-17T03:14:39.667521+0000","last_peered":"2024-09-17T03:14:39.667521+0000","last_clean":"2024-09-17T03:14:39.667521+0000","last_became_active":"2024-09-17T03:14:37.937349+0000","last_became_peered":"2024-09-17T03:14:37.937349+0000","last_unstale":"2024-09-17T03:14:39.667521+0000","last_undegraded":"2024-09-17T03:14:39.667521+0000","last_fullsized":"2024-09-17T03:14:39.667521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:49.312689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904741+0000","last_change":"2024-09-17T03:14:36.919006+0000","last_active":"2024-09-17T03:14:39.904741+0000","last_peered":"2024-09-17T03:14:39.904741+0000","last_clean":"2024-09-17T03:14:39.904741+0000","last_became_active":"2024-09-17T03:14:36.916543+0000","last_became_peered":"2024-09-17T03:14:36.916543+0000","last_unstale":"2024-09-17T03:14:39.904741+0000","last_undegraded":"2024-09-17T03:14:39.904741+0000","last_fullsized":"2024-09-17T03:14:39.904741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:46.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":144,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915414+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:14:38.915414+0000","last_peered":"2024-09-17T03:14:38.915414+0000","last_clean":"2024-09-17T03:14:38.915414+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:14:38.915414+0000","last_undegraded":"2024-09-17T03:14:38.915414+0000","last_fullsized":"2024-09-17T03:14:38.915414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":202451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":200807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:43.337 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 -- 172.21.15.153:0/1198066820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 msgr2=0x7faa900b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 --2- 172.21.15.153:0/1198066820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa900b3490 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa900cef10 tx=0x7faa7c02a660 comp rx=0 tx=0).stop 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 -- 172.21.15.153:0/1198066820 shutdown_connections 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 --2- 172.21.15.153:0/1198066820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa900b3490 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 -- 172.21.15.153:0/1198066820 >> 172.21.15.153:0/1198066820 conn(0x7faa9006f940 msgr2=0x7faa900b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 -- 172.21.15.153:0/1198066820 shutdown_connections 2024-09-17T03:14:43.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.593+0000 7faa94e00640 1 -- 172.21.15.153:0/1198066820 wait complete. 2024-09-17T03:14:43.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.595+0000 7faa94e00640 1 Processor -- start 2024-09-17T03:14:43.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.595+0000 7faa94e00640 1 -- start start 2024-09-17T03:14:43.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa90073dd0 0x7faa901f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa900b39d0 0x7faa901498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa900cf700 con 0x7faa90152530 2024-09-17T03:14:43.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faa900cf580 con 0x7faa90073dd0 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa94e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faa900cf880 con 0x7faa900b39d0 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43974/0 (socket says 172.21.15.153:43974) 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 -- 172.21.15.153:0/1004681511 learned_addr learned my addr 172.21.15.153:0/1004681511 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8f400640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa90073dd0 0x7faa901f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8ea00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa900b39d0 0x7faa901498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 -- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa900b39d0 msgr2=0x7faa901498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa900b39d0 0x7faa901498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 -- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa90073dd0 msgr2=0x7faa901f93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa90073dd0 0x7faa901f93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.597+0000 7faa8fe00640 1 -- 172.21.15.153:0/1004681511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90154f10 con 0x7faa90152530 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa8fe00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faa8800c760 tx=0x7faa8800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88003b70 con 0x7faa90152530 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa88003d10 con 0x7faa90152530 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa880052d0 con 0x7faa90152530 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa901551f0 con 0x7faa90152530 2024-09-17T03:14:43.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.598+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa900a9720 con 0x7faa90152530 2024-09-17T03:14:43.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.599+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa900b3490 con 0x7faa90152530 2024-09-17T03:14:43.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.601+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa88005470 con 0x7faa90152530 2024-09-17T03:14:43.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.602+0000 7faa87400640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 0x7faa7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.602+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7faa8809acc0 con 0x7faa90152530 2024-09-17T03:14:43.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.603+0000 7faa8f400640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 0x7faa7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.603+0000 7faa8f400640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 0x7faa7007b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa80000f60 tx=0x7faa80009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.607+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa880a1080 con 0x7faa90152530 2024-09-17T03:14:43.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.859+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faa9006d3b0 con 0x7faa90152530 2024-09-17T03:14:43.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.860+0000 7faa87400640 1 -- 172.21.15.153:0/1004681511 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1215 (secure 0 0 0) 0x7faa88062f60 con 0x7faa90152530 2024-09-17T03:14:43.859 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:43.859 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542801,"num_in_osds":8,"osd_in_since":1726542791,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226410496,"bytes_avail":772867702784,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"btime":"2024-09-17T03:14:40:924795+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5004}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-17T03:14:30.832505+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 msgr2=0x7faa7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 0x7faa7007b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa80000f60 tx=0x7faa80009040 comp rx=0 tx=0).stop 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 msgr2=0x7faa9015bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faa8800c760 tx=0x7faa8800cb60 comp rx=0 tx=0).stop 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 shutdown_connections 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faa70078b90 0x7faa7007b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa90152530 0x7faa9015bea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faa900b39d0 0x7faa901498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 --2- 172.21.15.153:0/1004681511 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faa90073dd0 0x7faa901f93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 >> 172.21.15.153:0/1004681511 conn(0x7faa9006f940 msgr2=0x7faa90150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 shutdown_connections 2024-09-17T03:14:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:43.862+0000 7faa94e00640 1 -- 172.21.15.153:0/1004681511 wait complete. 2024-09-17T03:14:43.883 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:14:43.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:44.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 -- 172.21.15.153:0/802805341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 msgr2=0x7fcc7806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 --2- 172.21.15.153:0/802805341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc7806ddf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc7815d980 tx=0x7fcc6002a540 comp rx=0 tx=0).stop 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 -- 172.21.15.153:0/802805341 shutdown_connections 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 --2- 172.21.15.153:0/802805341 >> v2:172.21.15.164:3300/0 conn(0x7fcc7806e330 0x7fcc7806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 --2- 172.21.15.153:0/802805341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc7806ddf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 -- 172.21.15.153:0/802805341 >> 172.21.15.153:0/802805341 conn(0x7fcc780cca40 msgr2=0x7fcc780cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 -- 172.21.15.153:0/802805341 shutdown_connections 2024-09-17T03:14:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.106+0000 7fcc7e000640 1 -- 172.21.15.153:0/802805341 wait complete. 2024-09-17T03:14:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.108+0000 7fcc7e000640 1 Processor -- start 2024-09-17T03:14:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.109+0000 7fcc7e000640 1 -- start start 2024-09-17T03:14:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 0x7fcc780a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc78074cb0 0x7fcc780b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7806f4a0 con 0x7fcc78073dd0 2024-09-17T03:14:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7806f320 con 0x7fcc78074cb0 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc7e000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7806f620 con 0x7fcc7806e330 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc6ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc6ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48348/0 (socket says 172.21.15.153:48348) 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc6ea00640 1 -- 172.21.15.153:0/1123841179 learned_addr learned my addr 172.21.15.153:0/1123841179 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc77e00640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc78074cb0 0x7fcc780b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.110+0000 7fcc77400640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 0x7fcc780a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 -- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 msgr2=0x7fcc780a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 0x7fcc780a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 -- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc78074cb0 msgr2=0x7fcc780b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc78074cb0 0x7fcc780b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 -- 172.21.15.153:0/1123841179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780c4940 con 0x7fcc78073dd0 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc77400640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 0x7fcc780a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:44.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6ea00640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc6002ab30 tx=0x7fcc60033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60005c90 con 0x7fcc78073dd0 2024-09-17T03:14:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc60031e50 con 0x7fcc78073dd0 2024-09-17T03:14:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7809f0d0 con 0x7fcc78073dd0 2024-09-17T03:14:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.111+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60005260 con 0x7fcc78073dd0 2024-09-17T03:14:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.112+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7809f5d0 con 0x7fcc78073dd0 2024-09-17T03:14:44.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.113+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7809f340 con 0x7fcc78073dd0 2024-09-17T03:14:44.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.114+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc60005400 con 0x7fcc78073dd0 2024-09-17T03:14:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.115+0000 7fcc6fe00640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.115+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fcc600bbfc0 con 0x7fcc78073dd0 2024-09-17T03:14:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.115+0000 7fcc77400640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.116+0000 7fcc77400640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007a50 tx=0x7fcc68009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.119+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc6003f030 con 0x7fcc78073dd0 2024-09-17T03:14:44.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.301+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc7806fb60 con 0x7fcc54078b90 2024-09-17T03:14:44.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.306+0000 7fcc6fe00640 1 -- 172.21.15.153:0/1123841179 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7fcc7806fb60 con 0x7fcc54078b90 2024-09-17T03:14:44.308 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:44.310 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:14:44.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.310+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 msgr2=0x7fcc5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.310+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007a50 tx=0x7fcc68009040 comp rx=0 tx=0).stop 2024-09-17T03:14:44.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.310+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 msgr2=0x7fcc780c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.310+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc6002ab30 tx=0x7fcc60033c20 comp rx=0 tx=0).stop 2024-09-17T03:14:44.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 shutdown_connections 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc78074cb0 0x7fcc780b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc78073dd0 0x7fcc780c4400 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 --2- 172.21.15.153:0/1123841179 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7806e330 0x7fcc780a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 >> 172.21.15.153:0/1123841179 conn(0x7fcc780cca40 msgr2=0x7fcc7815a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 shutdown_connections 2024-09-17T03:14:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:44.311+0000 7fcc7e000640 1 -- 172.21.15.153:0/1123841179 wait complete. 2024-09-17T03:14:44.331 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-17T03:14:42.834966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":4976640,"data_stored":2784584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919963+0000","last_change":"2024-09-17T03:14:37.916561+0000","last_active":"2024-09-17T03:14:38.919963+0000","last_peered":"2024-09-17T03:14:38.919963+0000","last_clean":"2024-09-17T03:14:38.919963+0000","last_became_active":"2024-09-17T03:14:37.916223+0000","last_became_peered":"2024-09-17T03:14:37.916223+0000","last_unstale":"2024-09-17T03:14:38.919963+0000","last_undegraded":"2024-09-17T03:14:38.919963+0000","last_fullsized":"2024-09-17T03:14:38.919963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:08.134288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923324+0000","last_change":"2024-09-17T03:14:37.918478+0000","last_active":"2024-09-17T03:14:37.923324+0000","last_peered":"2024-09-17T03:14:37.923324+0000","last_clean":"2024-09-17T03:14:37.923324+0000","last_became_active":"2024-09-17T03:14:37.918150+0000","last_became_peered":"2024-09-17T03:14:37.918150+0000","last_unstale":"2024-09-17T03:14:37.923324+0000","last_undegraded":"2024-09-17T03:14:37.923324+0000","last_fullsized":"2024-09-17T03:14:37.923324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:26.569385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919826+0000","last_change":"2024-09-17T03:14:37.918446+0000","last_active":"2024-09-17T03:14:38.919826+0000","last_peered":"2024-09-17T03:14:38.919826+0000","last_clean":"2024-09-17T03:14:38.919826+0000","last_became_active":"2024-09-17T03:14:37.911192+0000","last_became_peered":"2024-09-17T03:14:37.911192+0000","last_unstale":"2024-09-17T03:14:38.919826+0000","last_undegraded":"2024-09-17T03:14:38.919826+0000","last_fullsized":"2024-09-17T03:14:38.919826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:32.884580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919292+0000","last_change":"2024-09-17T03:14:37.925347+0000","last_active":"2024-09-17T03:14:38.919292+0000","last_peered":"2024-09-17T03:14:38.919292+0000","last_clean":"2024-09-17T03:14:38.919292+0000","last_became_active":"2024-09-17T03:14:37.924709+0000","last_became_peered":"2024-09-17T03:14:37.924709+0000","last_unstale":"2024-09-17T03:14:38.919292+0000","last_undegraded":"2024-09-17T03:14:38.919292+0000","last_fullsized":"2024-09-17T03:14:38.919292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:36.973784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917716+0000","last_change":"2024-09-17T03:14:37.935833+0000","last_active":"2024-09-17T03:14:38.917716+0000","last_peered":"2024-09-17T03:14:38.917716+0000","last_clean":"2024-09-17T03:14:38.917716+0000","last_became_active":"2024-09-17T03:14:37.935518+0000","last_became_peered":"2024-09-17T03:14:37.935518+0000","last_unstale":"2024-09-17T03:14:38.917716+0000","last_undegraded":"2024-09-17T03:14:38.917716+0000","last_fullsized":"2024-09-17T03:14:38.917716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:55.741697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.921589+0000","last_change":"2024-09-17T03:14:37.910208+0000","last_active":"2024-09-17T03:14:37.921589+0000","last_peered":"2024-09-17T03:14:37.921589+0000","last_clean":"2024-09-17T03:14:37.921589+0000","last_became_active":"2024-09-17T03:14:37.909810+0000","last_became_peered":"2024-09-17T03:14:37.909810+0000","last_unstale":"2024-09-17T03:14:37.921589+0000","last_undegraded":"2024-09-17T03:14:37.921589+0000","last_fullsized":"2024-09-17T03:14:37.921589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.990084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915499+0000","last_change":"2024-09-17T03:14:37.921919+0000","last_active":"2024-09-17T03:14:38.915499+0000","last_peered":"2024-09-17T03:14:38.915499+0000","last_clean":"2024-09-17T03:14:38.915499+0000","last_became_active":"2024-09-17T03:14:37.921605+0000","last_became_peered":"2024-09-17T03:14:37.921605+0000","last_unstale":"2024-09-17T03:14:38.915499+0000","last_undegraded":"2024-09-17T03:14:38.915499+0000","last_fullsized":"2024-09-17T03:14:38.915499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:04.482880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918503+0000","last_change":"2024-09-17T03:14:37.929874+0000","last_active":"2024-09-17T03:14:38.918503+0000","last_peered":"2024-09-17T03:14:38.918503+0000","last_clean":"2024-09-17T03:14:38.918503+0000","last_became_active":"2024-09-17T03:14:37.929183+0000","last_became_peered":"2024-09-17T03:14:37.929183+0000","last_unstale":"2024-09-17T03:14:38.918503+0000","last_undegraded":"2024-09-17T03:14:38.918503+0000","last_fullsized":"2024-09-17T03:14:38.918503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:07.984867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918320+0000","last_change":"2024-09-17T03:14:37.942264+0000","last_active":"2024-09-17T03:14:38.918320+0000","last_peered":"2024-09-17T03:14:38.918320+0000","last_clean":"2024-09-17T03:14:38.918320+0000","last_became_active":"2024-09-17T03:14:37.942048+0000","last_became_peered":"2024-09-17T03:14:37.942048+0000","last_unstale":"2024-09-17T03:14:38.918320+0000","last_undegraded":"2024-09-17T03:14:38.918320+0000","last_fullsized":"2024-09-17T03:14:38.918320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:47.951479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916140+0000","last_change":"2024-09-17T03:14:37.925527+0000","last_active":"2024-09-17T03:14:38.916140+0000","last_peered":"2024-09-17T03:14:38.916140+0000","last_clean":"2024-09-17T03:14:38.916140+0000","last_became_active":"2024-09-17T03:14:37.925210+0000","last_became_peered":"2024-09-17T03:14:37.925210+0000","last_unstale":"2024-09-17T03:14:38.916140+0000","last_undegraded":"2024-09-17T03:14:38.916140+0000","last_fullsized":"2024-09-17T03:14:38.916140+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:22.863410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905176+0000","last_change":"2024-09-17T03:14:37.933221+0000","last_active":"2024-09-17T03:14:39.905176+0000","last_peered":"2024-09-17T03:14:39.905176+0000","last_clean":"2024-09-17T03:14:39.905176+0000","last_became_active":"2024-09-17T03:14:37.931240+0000","last_became_peered":"2024-09-17T03:14:37.931240+0000","last_unstale":"2024-09-17T03:14:39.905176+0000","last_undegraded":"2024-09-17T03:14:39.905176+0000","last_fullsized":"2024-09-17T03:14:39.905176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:54.899035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918082+0000","last_change":"2024-09-17T03:14:37.928051+0000","last_active":"2024-09-17T03:14:38.918082+0000","last_peered":"2024-09-17T03:14:38.918082+0000","last_clean":"2024-09-17T03:14:38.918082+0000","last_became_active":"2024-09-17T03:14:37.927608+0000","last_became_peered":"2024-09-17T03:14:37.927608+0000","last_unstale":"2024-09-17T03:14:38.918082+0000","last_undegraded":"2024-09-17T03:14:38.918082+0000","last_fullsized":"2024-09-17T03:14:38.918082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:48.723198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915524+0000","last_change":"2024-09-17T03:14:37.916003+0000","last_active":"2024-09-17T03:14:38.915524+0000","last_peered":"2024-09-17T03:14:38.915524+0000","last_clean":"2024-09-17T03:14:38.915524+0000","last_became_active":"2024-09-17T03:14:37.915694+0000","last_became_peered":"2024-09-17T03:14:37.915694+0000","last_unstale":"2024-09-17T03:14:38.915524+0000","last_undegraded":"2024-09-17T03:14:38.915524+0000","last_fullsized":"2024-09-17T03:14:38.915524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:46.763114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247901+0000","last_change":"2024-09-17T03:14:37.923019+0000","last_active":"2024-09-17T03:14:40.247901+0000","last_peered":"2024-09-17T03:14:40.247901+0000","last_clean":"2024-09-17T03:14:40.247901+0000","last_became_active":"2024-09-17T03:14:37.922617+0000","last_became_peered":"2024-09-17T03:14:37.922617+0000","last_unstale":"2024-09-17T03:14:40.247901+0000","last_undegraded":"2024-09-17T03:14:40.247901+0000","last_fullsized":"2024-09-17T03:14:40.247901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:14.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.666997+0000","last_change":"2024-09-17T03:14:37.921909+0000","last_active":"2024-09-17T03:14:39.666997+0000","last_peered":"2024-09-17T03:14:39.666997+0000","last_clean":"2024-09-17T03:14:39.666997+0000","last_became_active":"2024-09-17T03:14:37.921309+0000","last_became_peered":"2024-09-17T03:14:37.921309+0000","last_unstale":"2024-09-17T03:14:39.666997+0000","last_undegraded":"2024-09-17T03:14:39.666997+0000","last_fullsized":"2024-09-17T03:14:39.666997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:05.255693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915715+0000","last_change":"2024-09-17T03:14:37.914801+0000","last_active":"2024-09-17T03:14:38.915715+0000","last_peered":"2024-09-17T03:14:38.915715+0000","last_clean":"2024-09-17T03:14:38.915715+0000","last_became_active":"2024-09-17T03:14:37.914491+0000","last_became_peered":"2024-09-17T03:14:37.914491+0000","last_unstale":"2024-09-17T03:14:38.915715+0000","last_undegraded":"2024-09-17T03:14:38.915715+0000","last_fullsized":"2024-09-17T03:14:38.915715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:20.802554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667600+0000","last_change":"2024-09-17T03:14:37.937593+0000","last_active":"2024-09-17T03:14:39.667600+0000","last_peered":"2024-09-17T03:14:39.667600+0000","last_clean":"2024-09-17T03:14:39.667600+0000","last_became_active":"2024-09-17T03:14:37.937342+0000","last_became_peered":"2024-09-17T03:14:37.937342+0000","last_unstale":"2024-09-17T03:14:39.667600+0000","last_undegraded":"2024-09-17T03:14:39.667600+0000","last_fullsized":"2024-09-17T03:14:39.667600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:23.222179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667556+0000","last_change":"2024-09-17T03:14:37.934795+0000","last_active":"2024-09-17T03:14:39.667556+0000","last_peered":"2024-09-17T03:14:39.667556+0000","last_clean":"2024-09-17T03:14:39.667556+0000","last_became_active":"2024-09-17T03:14:37.934439+0000","last_became_peered":"2024-09-17T03:14:37.934439+0000","last_unstale":"2024-09-17T03:14:39.667556+0000","last_undegraded":"2024-09-17T03:14:39.667556+0000","last_fullsized":"2024-09-17T03:14:39.667556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:52.920067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888271+0000","last_change":"2024-09-17T03:14:37.915377+0000","last_active":"2024-09-17T03:14:39.888271+0000","last_peered":"2024-09-17T03:14:39.888271+0000","last_clean":"2024-09-17T03:14:39.888271+0000","last_became_active":"2024-09-17T03:14:37.914255+0000","last_became_peered":"2024-09-17T03:14:37.914255+0000","last_unstale":"2024-09-17T03:14:39.888271+0000","last_undegraded":"2024-09-17T03:14:39.888271+0000","last_fullsized":"2024-09-17T03:14:39.888271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:44.283334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904963+0000","last_change":"2024-09-17T03:14:37.924877+0000","last_active":"2024-09-17T03:14:39.904963+0000","last_peered":"2024-09-17T03:14:39.904963+0000","last_clean":"2024-09-17T03:14:39.904963+0000","last_became_active":"2024-09-17T03:14:37.924524+0000","last_became_peered":"2024-09-17T03:14:37.924524+0000","last_unstale":"2024-09-17T03:14:39.904963+0000","last_undegraded":"2024-09-17T03:14:39.904963+0000","last_fullsized":"2024-09-17T03:14:39.904963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:59.046870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904797+0000","last_change":"2024-09-17T03:14:37.934335+0000","last_active":"2024-09-17T03:14:39.904797+0000","last_peered":"2024-09-17T03:14:39.904797+0000","last_clean":"2024-09-17T03:14:39.904797+0000","last_became_active":"2024-09-17T03:14:37.934087+0000","last_became_peered":"2024-09-17T03:14:37.934087+0000","last_unstale":"2024-09-17T03:14:39.904797+0000","last_undegraded":"2024-09-17T03:14:39.904797+0000","last_fullsized":"2024-09-17T03:14:39.904797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:00.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904716+0000","last_change":"2024-09-17T03:14:37.931737+0000","last_active":"2024-09-17T03:14:39.904716+0000","last_peered":"2024-09-17T03:14:39.904716+0000","last_clean":"2024-09-17T03:14:39.904716+0000","last_became_active":"2024-09-17T03:14:37.931268+0000","last_became_peered":"2024-09-17T03:14:37.931268+0000","last_unstale":"2024-09-17T03:14:39.904716+0000","last_undegraded":"2024-09-17T03:14:39.904716+0000","last_fullsized":"2024-09-17T03:14:39.904716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:25.010704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667042+0000","last_change":"2024-09-17T03:14:37.918889+0000","last_active":"2024-09-17T03:14:39.667042+0000","last_peered":"2024-09-17T03:14:39.667042+0000","last_clean":"2024-09-17T03:14:39.667042+0000","last_became_active":"2024-09-17T03:14:37.918600+0000","last_became_peered":"2024-09-17T03:14:37.918600+0000","last_unstale":"2024-09-17T03:14:39.667042+0000","last_undegraded":"2024-09-17T03:14:39.667042+0000","last_fullsized":"2024-09-17T03:14:39.667042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.718131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918713+0000","last_change":"2024-09-17T03:14:37.925187+0000","last_active":"2024-09-17T03:14:38.918713+0000","last_peered":"2024-09-17T03:14:38.918713+0000","last_clean":"2024-09-17T03:14:38.918713+0000","last_became_active":"2024-09-17T03:14:37.921554+0000","last_became_peered":"2024-09-17T03:14:37.921554+0000","last_unstale":"2024-09-17T03:14:38.918713+0000","last_undegraded":"2024-09-17T03:14:38.918713+0000","last_fullsized":"2024-09-17T03:14:38.918713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:00.487725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248111+0000","last_change":"2024-09-17T03:14:37.918971+0000","last_active":"2024-09-17T03:14:40.248111+0000","last_peered":"2024-09-17T03:14:40.248111+0000","last_clean":"2024-09-17T03:14:40.248111+0000","last_became_active":"2024-09-17T03:14:37.918667+0000","last_became_peered":"2024-09-17T03:14:37.918667+0000","last_unstale":"2024-09-17T03:14:40.248111+0000","last_undegraded":"2024-09-17T03:14:40.248111+0000","last_fullsized":"2024-09-17T03:14:40.248111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:39.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919882+0000","last_change":"2024-09-17T03:14:37.914820+0000","last_active":"2024-09-17T03:14:38.919882+0000","last_peered":"2024-09-17T03:14:38.919882+0000","last_clean":"2024-09-17T03:14:38.919882+0000","last_became_active":"2024-09-17T03:14:37.914525+0000","last_became_peered":"2024-09-17T03:14:37.914525+0000","last_unstale":"2024-09-17T03:14:38.919882+0000","last_undegraded":"2024-09-17T03:14:38.919882+0000","last_fullsized":"2024-09-17T03:14:38.919882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:02.988944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905289+0000","last_change":"2024-09-17T03:14:37.937272+0000","last_active":"2024-09-17T03:14:39.905289+0000","last_peered":"2024-09-17T03:14:39.905289+0000","last_clean":"2024-09-17T03:14:39.905289+0000","last_became_active":"2024-09-17T03:14:37.929899+0000","last_became_peered":"2024-09-17T03:14:37.929899+0000","last_unstale":"2024-09-17T03:14:39.905289+0000","last_undegraded":"2024-09-17T03:14:39.905289+0000","last_fullsized":"2024-09-17T03:14:39.905289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:45.514112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916045+0000","last_change":"2024-09-17T03:14:37.908890+0000","last_active":"2024-09-17T03:14:38.916045+0000","last_peered":"2024-09-17T03:14:38.916045+0000","last_clean":"2024-09-17T03:14:38.916045+0000","last_became_active":"2024-09-17T03:14:37.908582+0000","last_became_peered":"2024-09-17T03:14:37.908582+0000","last_unstale":"2024-09-17T03:14:38.916045+0000","last_undegraded":"2024-09-17T03:14:38.916045+0000","last_fullsized":"2024-09-17T03:14:38.916045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:46.004166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667433+0000","last_change":"2024-09-17T03:14:37.918649+0000","last_active":"2024-09-17T03:14:39.667433+0000","last_peered":"2024-09-17T03:14:39.667433+0000","last_clean":"2024-09-17T03:14:39.667433+0000","last_became_active":"2024-09-17T03:14:37.914911+0000","last_became_peered":"2024-09-17T03:14:37.914911+0000","last_unstale":"2024-09-17T03:14:39.667433+0000","last_undegraded":"2024-09-17T03:14:39.667433+0000","last_fullsized":"2024-09-17T03:14:39.667433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:43.998632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667101+0000","last_change":"2024-09-17T03:14:37.932532+0000","last_active":"2024-09-17T03:14:39.667101+0000","last_peered":"2024-09-17T03:14:39.667101+0000","last_clean":"2024-09-17T03:14:39.667101+0000","last_became_active":"2024-09-17T03:14:37.931864+0000","last_became_peered":"2024-09-17T03:14:37.931864+0000","last_unstale":"2024-09-17T03:14:39.667101+0000","last_undegraded":"2024-09-17T03:14:39.667101+0000","last_fullsized":"2024-09-17T03:14:39.667101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:45.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915497+0000","last_change":"2024-09-17T03:14:37.910258+0000","last_active":"2024-09-17T03:14:38.915497+0000","last_peered":"2024-09-17T03:14:38.915497+0000","last_clean":"2024-09-17T03:14:38.915497+0000","last_became_active":"2024-09-17T03:14:37.909949+0000","last_became_peered":"2024-09-17T03:14:37.909949+0000","last_unstale":"2024-09-17T03:14:38.915497+0000","last_undegraded":"2024-09-17T03:14:38.915497+0000","last_fullsized":"2024-09-17T03:14:38.915497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:23.024922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918936+0000","last_change":"2024-09-17T03:14:37.929536+0000","last_active":"2024-09-17T03:14:38.918936+0000","last_peered":"2024-09-17T03:14:38.918936+0000","last_clean":"2024-09-17T03:14:38.918936+0000","last_became_active":"2024-09-17T03:14:37.924822+0000","last_became_peered":"2024-09-17T03:14:37.924822+0000","last_unstale":"2024-09-17T03:14:38.918936+0000","last_undegraded":"2024-09-17T03:14:38.918936+0000","last_fullsized":"2024-09-17T03:14:38.918936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:00.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667368+0000","last_change":"2024-09-17T03:14:37.922333+0000","last_active":"2024-09-17T03:14:39.667368+0000","last_peered":"2024-09-17T03:14:39.667368+0000","last_clean":"2024-09-17T03:14:39.667368+0000","last_became_active":"2024-09-17T03:14:37.919774+0000","last_became_peered":"2024-09-17T03:14:37.919774+0000","last_unstale":"2024-09-17T03:14:39.667368+0000","last_undegraded":"2024-09-17T03:14:39.667368+0000","last_fullsized":"2024-09-17T03:14:39.667368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:29.964627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248024+0000","last_change":"2024-09-17T03:14:36.919459+0000","last_active":"2024-09-17T03:14:40.248024+0000","last_peered":"2024-09-17T03:14:40.248024+0000","last_clean":"2024-09-17T03:14:40.248024+0000","last_became_active":"2024-09-17T03:14:36.919157+0000","last_became_peered":"2024-09-17T03:14:36.919157+0000","last_unstale":"2024-09-17T03:14:40.248024+0000","last_undegraded":"2024-09-17T03:14:40.248024+0000","last_fullsized":"2024-09-17T03:14:40.248024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:03.170093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.926962+0000","last_change":"2024-09-17T03:14:37.912463+0000","last_active":"2024-09-17T03:14:37.926962+0000","last_peered":"2024-09-17T03:14:37.926962+0000","last_clean":"2024-09-17T03:14:37.926962+0000","last_became_active":"2024-09-17T03:14:37.912103+0000","last_became_peered":"2024-09-17T03:14:37.912103+0000","last_unstale":"2024-09-17T03:14:37.926962+0000","last_undegraded":"2024-09-17T03:14:37.926962+0000","last_fullsized":"2024-09-17T03:14:37.926962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.944223+0000","last_change":"2024-09-17T03:14:36.914189+0000","last_active":"2024-09-17T03:14:37.944223+0000","last_peered":"2024-09-17T03:14:37.944223+0000","last_clean":"2024-09-17T03:14:37.944223+0000","last_became_active":"2024-09-17T03:14:36.913759+0000","last_became_peered":"2024-09-17T03:14:36.913759+0000","last_unstale":"2024-09-17T03:14:37.944223+0000","last_undegraded":"2024-09-17T03:14:37.944223+0000","last_fullsized":"2024-09-17T03:14:37.944223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667500+0000","last_change":"2024-09-17T03:14:37.921729+0000","last_active":"2024-09-17T03:14:39.667500+0000","last_peered":"2024-09-17T03:14:39.667500+0000","last_clean":"2024-09-17T03:14:39.667500+0000","last_became_active":"2024-09-17T03:14:37.921290+0000","last_became_peered":"2024-09-17T03:14:37.921290+0000","last_unstale":"2024-09-17T03:14:39.667500+0000","last_undegraded":"2024-09-17T03:14:39.667500+0000","last_fullsized":"2024-09-17T03:14:39.667500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:22.375459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919802+0000","last_change":"2024-09-17T03:14:36.915336+0000","last_active":"2024-09-17T03:14:38.919802+0000","last_peered":"2024-09-17T03:14:38.919802+0000","last_clean":"2024-09-17T03:14:38.919802+0000","last_became_active":"2024-09-17T03:14:36.914976+0000","last_became_peered":"2024-09-17T03:14:36.914976+0000","last_unstale":"2024-09-17T03:14:38.919802+0000","last_undegraded":"2024-09-17T03:14:38.919802+0000","last_fullsized":"2024-09-17T03:14:38.919802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:43.593532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.930975+0000","last_change":"2024-09-17T03:14:37.929582+0000","last_active":"2024-09-17T03:14:37.930975+0000","last_peered":"2024-09-17T03:14:37.930975+0000","last_clean":"2024-09-17T03:14:37.930975+0000","last_became_active":"2024-09-17T03:14:37.929244+0000","last_became_peered":"2024-09-17T03:14:37.929244+0000","last_unstale":"2024-09-17T03:14:37.930975+0000","last_undegraded":"2024-09-17T03:14:37.930975+0000","last_fullsized":"2024-09-17T03:14:37.930975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:57.378613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247778+0000","last_change":"2024-09-17T03:14:36.923785+0000","last_active":"2024-09-17T03:14:40.247778+0000","last_peered":"2024-09-17T03:14:40.247778+0000","last_clean":"2024-09-17T03:14:40.247778+0000","last_became_active":"2024-09-17T03:14:36.923407+0000","last_became_peered":"2024-09-17T03:14:36.923407+0000","last_unstale":"2024-09-17T03:14:40.247778+0000","last_undegraded":"2024-09-17T03:14:40.247778+0000","last_fullsized":"2024-09-17T03:14:40.247778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:19.669130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919184+0000","last_change":"2024-09-17T03:14:37.935225+0000","last_active":"2024-09-17T03:14:38.919184+0000","last_peered":"2024-09-17T03:14:38.919184+0000","last_clean":"2024-09-17T03:14:38.919184+0000","last_became_active":"2024-09-17T03:14:37.934527+0000","last_became_peered":"2024-09-17T03:14:37.934527+0000","last_unstale":"2024-09-17T03:14:38.919184+0000","last_undegraded":"2024-09-17T03:14:38.919184+0000","last_fullsized":"2024-09-17T03:14:38.919184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:00.004933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247756+0000","last_change":"2024-09-17T03:14:36.918145+0000","last_active":"2024-09-17T03:14:40.247756+0000","last_peered":"2024-09-17T03:14:40.247756+0000","last_clean":"2024-09-17T03:14:40.247756+0000","last_became_active":"2024-09-17T03:14:36.917775+0000","last_became_peered":"2024-09-17T03:14:36.917775+0000","last_unstale":"2024-09-17T03:14:40.247756+0000","last_undegraded":"2024-09-17T03:14:40.247756+0000","last_fullsized":"2024-09-17T03:14:40.247756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:57.115028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904752+0000","last_change":"2024-09-17T03:14:37.928437+0000","last_active":"2024-09-17T03:14:39.904752+0000","last_peered":"2024-09-17T03:14:39.904752+0000","last_clean":"2024-09-17T03:14:39.904752+0000","last_became_active":"2024-09-17T03:14:37.928129+0000","last_became_peered":"2024-09-17T03:14:37.928129+0000","last_unstale":"2024-09-17T03:14:39.904752+0000","last_undegraded":"2024-09-17T03:14:39.904752+0000","last_fullsized":"2024-09-17T03:14:39.904752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:38.645776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915486+0000","last_change":"2024-09-17T03:14:36.919059+0000","last_active":"2024-09-17T03:14:38.915486+0000","last_peered":"2024-09-17T03:14:38.915486+0000","last_clean":"2024-09-17T03:14:38.915486+0000","last_became_active":"2024-09-17T03:14:36.918746+0000","last_became_peered":"2024-09-17T03:14:36.918746+0000","last_unstale":"2024-09-17T03:14:38.915486+0000","last_undegraded":"2024-09-17T03:14:38.915486+0000","last_fullsized":"2024-09-17T03:14:38.915486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:59.611828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667169+0000","last_change":"2024-09-17T03:14:37.932207+0000","last_active":"2024-09-17T03:14:39.667169+0000","last_peered":"2024-09-17T03:14:39.667169+0000","last_clean":"2024-09-17T03:14:39.667169+0000","last_became_active":"2024-09-17T03:14:37.931501+0000","last_became_peered":"2024-09-17T03:14:37.931501+0000","last_unstale":"2024-09-17T03:14:39.667169+0000","last_undegraded":"2024-09-17T03:14:39.667169+0000","last_fullsized":"2024-09-17T03:14:39.667169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:11.603444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917655+0000","last_change":"2024-09-17T03:14:36.925978+0000","last_active":"2024-09-17T03:14:38.917655+0000","last_peered":"2024-09-17T03:14:38.917655+0000","last_clean":"2024-09-17T03:14:38.917655+0000","last_became_active":"2024-09-17T03:14:36.925675+0000","last_became_peered":"2024-09-17T03:14:36.925675+0000","last_unstale":"2024-09-17T03:14:38.917655+0000","last_undegraded":"2024-09-17T03:14:38.917655+0000","last_fullsized":"2024-09-17T03:14:38.917655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:51.069808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.928836+0000","last_change":"2024-09-17T03:14:37.927188+0000","last_active":"2024-09-17T03:14:37.928836+0000","last_peered":"2024-09-17T03:14:37.928836+0000","last_clean":"2024-09-17T03:14:37.928836+0000","last_became_active":"2024-09-17T03:14:37.923498+0000","last_became_peered":"2024-09-17T03:14:37.923498+0000","last_unstale":"2024-09-17T03:14:37.928836+0000","last_undegraded":"2024-09-17T03:14:37.928836+0000","last_fullsized":"2024-09-17T03:14:37.928836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:23.785026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915284+0000","last_change":"2024-09-17T03:14:36.912696+0000","last_active":"2024-09-17T03:14:38.915284+0000","last_peered":"2024-09-17T03:14:38.915284+0000","last_clean":"2024-09-17T03:14:38.915284+0000","last_became_active":"2024-09-17T03:14:36.912364+0000","last_became_peered":"2024-09-17T03:14:36.912364+0000","last_unstale":"2024-09-17T03:14:38.915284+0000","last_undegraded":"2024-09-17T03:14:38.915284+0000","last_fullsized":"2024-09-17T03:14:38.915284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:41.054162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919396+0000","last_change":"2024-09-17T03:14:37.925010+0000","last_active":"2024-09-17T03:14:38.919396+0000","last_peered":"2024-09-17T03:14:38.919396+0000","last_clean":"2024-09-17T03:14:38.919396+0000","last_became_active":"2024-09-17T03:14:37.924289+0000","last_became_peered":"2024-09-17T03:14:37.924289+0000","last_unstale":"2024-09-17T03:14:38.919396+0000","last_undegraded":"2024-09-17T03:14:38.919396+0000","last_fullsized":"2024-09-17T03:14:38.919396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.128576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.920023+0000","last_change":"2024-09-17T03:14:36.918393+0000","last_active":"2024-09-17T03:14:38.920023+0000","last_peered":"2024-09-17T03:14:38.920023+0000","last_clean":"2024-09-17T03:14:38.920023+0000","last_became_active":"2024-09-17T03:14:36.918003+0000","last_became_peered":"2024-09-17T03:14:36.918003+0000","last_unstale":"2024-09-17T03:14:38.920023+0000","last_undegraded":"2024-09-17T03:14:38.920023+0000","last_fullsized":"2024-09-17T03:14:38.920023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:45.151063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248033+0000","last_change":"2024-09-17T03:14:37.924828+0000","last_active":"2024-09-17T03:14:40.248033+0000","last_peered":"2024-09-17T03:14:40.248033+0000","last_clean":"2024-09-17T03:14:40.248033+0000","last_became_active":"2024-09-17T03:14:37.917570+0000","last_became_peered":"2024-09-17T03:14:37.917570+0000","last_unstale":"2024-09-17T03:14:40.248033+0000","last_undegraded":"2024-09-17T03:14:40.248033+0000","last_fullsized":"2024-09-17T03:14:40.248033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:27.498618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667189+0000","last_change":"2024-09-17T03:14:36.918369+0000","last_active":"2024-09-17T03:14:39.667189+0000","last_peered":"2024-09-17T03:14:39.667189+0000","last_clean":"2024-09-17T03:14:39.667189+0000","last_became_active":"2024-09-17T03:14:36.918103+0000","last_became_peered":"2024-09-17T03:14:36.918103+0000","last_unstale":"2024-09-17T03:14:39.667189+0000","last_undegraded":"2024-09-17T03:14:39.667189+0000","last_fullsized":"2024-09-17T03:14:39.667189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:29.198060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919959+0000","last_change":"2024-09-17T03:14:37.919968+0000","last_active":"2024-09-17T03:14:38.919959+0000","last_peered":"2024-09-17T03:14:38.919959+0000","last_clean":"2024-09-17T03:14:38.919959+0000","last_became_active":"2024-09-17T03:14:37.919606+0000","last_became_peered":"2024-09-17T03:14:37.919606+0000","last_unstale":"2024-09-17T03:14:38.919959+0000","last_undegraded":"2024-09-17T03:14:38.919959+0000","last_fullsized":"2024-09-17T03:14:38.919959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:29.688951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667040+0000","last_change":"2024-09-17T03:14:36.922737+0000","last_active":"2024-09-17T03:14:39.667040+0000","last_peered":"2024-09-17T03:14:39.667040+0000","last_clean":"2024-09-17T03:14:39.667040+0000","last_became_active":"2024-09-17T03:14:36.922473+0000","last_became_peered":"2024-09-17T03:14:36.922473+0000","last_unstale":"2024-09-17T03:14:39.667040+0000","last_undegraded":"2024-09-17T03:14:39.667040+0000","last_fullsized":"2024-09-17T03:14:39.667040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:01.501489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916734+0000","last_change":"2024-09-17T03:14:37.922491+0000","last_active":"2024-09-17T03:14:38.916734+0000","last_peered":"2024-09-17T03:14:38.916734+0000","last_clean":"2024-09-17T03:14:38.916734+0000","last_became_active":"2024-09-17T03:14:37.922210+0000","last_became_peered":"2024-09-17T03:14:37.922210+0000","last_unstale":"2024-09-17T03:14:38.916734+0000","last_undegraded":"2024-09-17T03:14:38.916734+0000","last_fullsized":"2024-09-17T03:14:38.916734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:45.166992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919354+0000","last_change":"2024-09-17T03:14:36.920649+0000","last_active":"2024-09-17T03:14:38.919354+0000","last_peered":"2024-09-17T03:14:38.919354+0000","last_clean":"2024-09-17T03:14:38.919354+0000","last_became_active":"2024-09-17T03:14:36.920336+0000","last_became_peered":"2024-09-17T03:14:36.920336+0000","last_unstale":"2024-09-17T03:14:38.919354+0000","last_undegraded":"2024-09-17T03:14:38.919354+0000","last_fullsized":"2024-09-17T03:14:38.919354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:40.796766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919439+0000","last_change":"2024-09-17T03:14:37.925567+0000","last_active":"2024-09-17T03:14:38.919439+0000","last_peered":"2024-09-17T03:14:38.919439+0000","last_clean":"2024-09-17T03:14:38.919439+0000","last_became_active":"2024-09-17T03:14:37.924189+0000","last_became_peered":"2024-09-17T03:14:37.924189+0000","last_unstale":"2024-09-17T03:14:38.919439+0000","last_undegraded":"2024-09-17T03:14:38.919439+0000","last_fullsized":"2024-09-17T03:14:38.919439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:27.639246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918927+0000","last_change":"2024-09-17T03:14:36.915616+0000","last_active":"2024-09-17T03:14:38.918927+0000","last_peered":"2024-09-17T03:14:38.918927+0000","last_clean":"2024-09-17T03:14:38.918927+0000","last_became_active":"2024-09-17T03:14:36.915341+0000","last_became_peered":"2024-09-17T03:14:36.915341+0000","last_unstale":"2024-09-17T03:14:38.918927+0000","last_undegraded":"2024-09-17T03:14:38.918927+0000","last_fullsized":"2024-09-17T03:14:38.918927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:13.253503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.920702+0000","last_change":"2024-09-17T03:14:37.913219+0000","last_active":"2024-09-17T03:14:37.920702+0000","last_peered":"2024-09-17T03:14:37.920702+0000","last_clean":"2024-09-17T03:14:37.920702+0000","last_became_active":"2024-09-17T03:14:37.912848+0000","last_became_peered":"2024-09-17T03:14:37.912848+0000","last_unstale":"2024-09-17T03:14:37.920702+0000","last_undegraded":"2024-09-17T03:14:37.920702+0000","last_fullsized":"2024-09-17T03:14:37.920702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.908019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.901011+0000","last_change":"2024-09-17T03:14:36.906986+0000","last_active":"2024-09-17T03:14:37.901011+0000","last_peered":"2024-09-17T03:14:37.901011+0000","last_clean":"2024-09-17T03:14:37.901011+0000","last_became_active":"2024-09-17T03:14:36.906610+0000","last_became_peered":"2024-09-17T03:14:36.906610+0000","last_unstale":"2024-09-17T03:14:37.901011+0000","last_undegraded":"2024-09-17T03:14:37.901011+0000","last_fullsized":"2024-09-17T03:14:37.901011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:06.494486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905169+0000","last_change":"2024-09-17T03:14:37.924573+0000","last_active":"2024-09-17T03:14:39.905169+0000","last_peered":"2024-09-17T03:14:39.905169+0000","last_clean":"2024-09-17T03:14:39.905169+0000","last_became_active":"2024-09-17T03:14:37.917759+0000","last_became_peered":"2024-09-17T03:14:37.917759+0000","last_unstale":"2024-09-17T03:14:39.905169+0000","last_undegraded":"2024-09-17T03:14:39.905169+0000","last_fullsized":"2024-09-17T03:14:39.905169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:28.247627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667188+0000","last_change":"2024-09-17T03:14:36.924180+0000","last_active":"2024-09-17T03:14:39.667188+0000","last_peered":"2024-09-17T03:14:39.667188+0000","last_clean":"2024-09-17T03:14:39.667188+0000","last_became_active":"2024-09-17T03:14:36.923781+0000","last_became_peered":"2024-09-17T03:14:36.923781+0000","last_unstale":"2024-09-17T03:14:39.667188+0000","last_undegraded":"2024-09-17T03:14:39.667188+0000","last_fullsized":"2024-09-17T03:14:39.667188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:44.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917971+0000","last_change":"2024-09-17T03:14:37.931956+0000","last_active":"2024-09-17T03:14:38.917971+0000","last_peered":"2024-09-17T03:14:38.917971+0000","last_clean":"2024-09-17T03:14:38.917971+0000","last_became_active":"2024-09-17T03:14:37.931464+0000","last_became_peered":"2024-09-17T03:14:37.931464+0000","last_unstale":"2024-09-17T03:14:38.917971+0000","last_undegraded":"2024-09-17T03:14:38.917971+0000","last_fullsized":"2024-09-17T03:14:38.917971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:03.949546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247727+0000","last_change":"2024-09-17T03:14:36.921381+0000","last_active":"2024-09-17T03:14:40.247727+0000","last_peered":"2024-09-17T03:14:40.247727+0000","last_clean":"2024-09-17T03:14:40.247727+0000","last_became_active":"2024-09-17T03:14:36.921084+0000","last_became_peered":"2024-09-17T03:14:36.921084+0000","last_unstale":"2024-09-17T03:14:40.247727+0000","last_undegraded":"2024-09-17T03:14:40.247727+0000","last_fullsized":"2024-09-17T03:14:40.247727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.923307+0000","last_change":"2024-09-17T03:14:37.916083+0000","last_active":"2024-09-17T03:14:37.923307+0000","last_peered":"2024-09-17T03:14:37.923307+0000","last_clean":"2024-09-17T03:14:37.923307+0000","last_became_active":"2024-09-17T03:14:37.912339+0000","last_became_peered":"2024-09-17T03:14:37.912339+0000","last_unstale":"2024-09-17T03:14:37.923307+0000","last_undegraded":"2024-09-17T03:14:37.923307+0000","last_fullsized":"2024-09-17T03:14:37.923307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:09.389752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916628+0000","last_change":"2024-09-17T03:14:36.921428+0000","last_active":"2024-09-17T03:14:38.916628+0000","last_peered":"2024-09-17T03:14:38.916628+0000","last_clean":"2024-09-17T03:14:38.916628+0000","last_became_active":"2024-09-17T03:14:36.921123+0000","last_became_peered":"2024-09-17T03:14:36.921123+0000","last_unstale":"2024-09-17T03:14:38.916628+0000","last_undegraded":"2024-09-17T03:14:38.916628+0000","last_fullsized":"2024-09-17T03:14:38.916628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.979021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916162+0000","last_change":"2024-09-17T03:14:37.909600+0000","last_active":"2024-09-17T03:14:38.916162+0000","last_peered":"2024-09-17T03:14:38.916162+0000","last_clean":"2024-09-17T03:14:38.916162+0000","last_became_active":"2024-09-17T03:14:37.909209+0000","last_became_peered":"2024-09-17T03:14:37.909209+0000","last_unstale":"2024-09-17T03:14:38.916162+0000","last_undegraded":"2024-09-17T03:14:38.916162+0000","last_fullsized":"2024-09-17T03:14:38.916162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:28.685662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667330+0000","last_change":"2024-09-17T03:14:36.923058+0000","last_active":"2024-09-17T03:14:39.667330+0000","last_peered":"2024-09-17T03:14:39.667330+0000","last_clean":"2024-09-17T03:14:39.667330+0000","last_became_active":"2024-09-17T03:14:36.922736+0000","last_became_peered":"2024-09-17T03:14:36.922736+0000","last_unstale":"2024-09-17T03:14:39.667330+0000","last_undegraded":"2024-09-17T03:14:39.667330+0000","last_fullsized":"2024-09-17T03:14:39.667330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:52.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916722+0000","last_change":"2024-09-17T03:14:37.910283+0000","last_active":"2024-09-17T03:14:38.916722+0000","last_peered":"2024-09-17T03:14:38.916722+0000","last_clean":"2024-09-17T03:14:38.916722+0000","last_became_active":"2024-09-17T03:14:37.909976+0000","last_became_peered":"2024-09-17T03:14:37.909976+0000","last_unstale":"2024-09-17T03:14:38.916722+0000","last_undegraded":"2024-09-17T03:14:38.916722+0000","last_fullsized":"2024-09-17T03:14:38.916722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:59.534040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917812+0000","last_change":"2024-09-17T03:14:36.922118+0000","last_active":"2024-09-17T03:14:38.917812+0000","last_peered":"2024-09-17T03:14:38.917812+0000","last_clean":"2024-09-17T03:14:38.917812+0000","last_became_active":"2024-09-17T03:14:36.921777+0000","last_became_peered":"2024-09-17T03:14:36.921777+0000","last_unstale":"2024-09-17T03:14:38.917812+0000","last_undegraded":"2024-09-17T03:14:38.917812+0000","last_fullsized":"2024-09-17T03:14:38.917812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:58.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888423+0000","last_change":"2024-09-17T03:14:37.911362+0000","last_active":"2024-09-17T03:14:39.888423+0000","last_peered":"2024-09-17T03:14:39.888423+0000","last_clean":"2024-09-17T03:14:39.888423+0000","last_became_active":"2024-09-17T03:14:37.911051+0000","last_became_peered":"2024-09-17T03:14:37.911051+0000","last_unstale":"2024-09-17T03:14:39.888423+0000","last_undegraded":"2024-09-17T03:14:39.888423+0000","last_fullsized":"2024-09-17T03:14:39.888423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888029+0000","last_change":"2024-09-17T03:14:36.919877+0000","last_active":"2024-09-17T03:14:39.888029+0000","last_peered":"2024-09-17T03:14:39.888029+0000","last_clean":"2024-09-17T03:14:39.888029+0000","last_became_active":"2024-09-17T03:14:36.919462+0000","last_became_peered":"2024-09-17T03:14:36.919462+0000","last_unstale":"2024-09-17T03:14:39.888029+0000","last_undegraded":"2024-09-17T03:14:39.888029+0000","last_fullsized":"2024-09-17T03:14:39.888029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:30.380746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667035+0000","last_change":"2024-09-17T03:14:37.915400+0000","last_active":"2024-09-17T03:14:39.667035+0000","last_peered":"2024-09-17T03:14:39.667035+0000","last_clean":"2024-09-17T03:14:39.667035+0000","last_became_active":"2024-09-17T03:14:37.914731+0000","last_became_peered":"2024-09-17T03:14:37.914731+0000","last_unstale":"2024-09-17T03:14:39.667035+0000","last_undegraded":"2024-09-17T03:14:39.667035+0000","last_fullsized":"2024-09-17T03:14:39.667035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:12.610229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.887984+0000","last_change":"2024-09-17T03:14:36.917828+0000","last_active":"2024-09-17T03:14:39.887984+0000","last_peered":"2024-09-17T03:14:39.887984+0000","last_clean":"2024-09-17T03:14:39.887984+0000","last_became_active":"2024-09-17T03:14:36.917563+0000","last_became_peered":"2024-09-17T03:14:36.917563+0000","last_unstale":"2024-09-17T03:14:39.887984+0000","last_undegraded":"2024-09-17T03:14:39.887984+0000","last_fullsized":"2024-09-17T03:14:39.887984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917584+0000","last_change":"2024-09-17T03:14:37.912226+0000","last_active":"2024-09-17T03:14:38.917584+0000","last_peered":"2024-09-17T03:14:38.917584+0000","last_clean":"2024-09-17T03:14:38.917584+0000","last_became_active":"2024-09-17T03:14:37.911946+0000","last_became_peered":"2024-09-17T03:14:37.911946+0000","last_unstale":"2024-09-17T03:14:38.917584+0000","last_undegraded":"2024-09-17T03:14:38.917584+0000","last_fullsized":"2024-09-17T03:14:38.917584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:48.422868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.902420+0000","last_change":"2024-09-17T03:14:36.911465+0000","last_active":"2024-09-17T03:14:37.902420+0000","last_peered":"2024-09-17T03:14:37.902420+0000","last_clean":"2024-09-17T03:14:37.902420+0000","last_became_active":"2024-09-17T03:14:36.910962+0000","last_became_peered":"2024-09-17T03:14:36.910962+0000","last_unstale":"2024-09-17T03:14:37.902420+0000","last_undegraded":"2024-09-17T03:14:37.902420+0000","last_fullsized":"2024-09-17T03:14:37.902420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.148718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904731+0000","last_change":"2024-09-17T03:14:37.931537+0000","last_active":"2024-09-17T03:14:39.904731+0000","last_peered":"2024-09-17T03:14:39.904731+0000","last_clean":"2024-09-17T03:14:39.904731+0000","last_became_active":"2024-09-17T03:14:37.930870+0000","last_became_peered":"2024-09-17T03:14:37.930870+0000","last_unstale":"2024-09-17T03:14:39.904731+0000","last_undegraded":"2024-09-17T03:14:39.904731+0000","last_fullsized":"2024-09-17T03:14:39.904731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915570+0000","last_change":"2024-09-17T03:14:36.913626+0000","last_active":"2024-09-17T03:14:38.915570+0000","last_peered":"2024-09-17T03:14:38.915570+0000","last_clean":"2024-09-17T03:14:38.915570+0000","last_became_active":"2024-09-17T03:14:36.912768+0000","last_became_peered":"2024-09-17T03:14:36.912768+0000","last_unstale":"2024-09-17T03:14:38.915570+0000","last_undegraded":"2024-09-17T03:14:38.915570+0000","last_fullsized":"2024-09-17T03:14:38.915570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.517940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919003+0000","last_change":"2024-09-17T03:14:37.919753+0000","last_active":"2024-09-17T03:14:38.919003+0000","last_peered":"2024-09-17T03:14:38.919003+0000","last_clean":"2024-09-17T03:14:38.919003+0000","last_became_active":"2024-09-17T03:14:37.919458+0000","last_became_peered":"2024-09-17T03:14:37.919458+0000","last_unstale":"2024-09-17T03:14:38.919003+0000","last_undegraded":"2024-09-17T03:14:38.919003+0000","last_fullsized":"2024-09-17T03:14:38.919003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:00.443720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.900455+0000","last_change":"2024-09-17T03:14:36.924434+0000","last_active":"2024-09-17T03:14:37.900455+0000","last_peered":"2024-09-17T03:14:37.900455+0000","last_clean":"2024-09-17T03:14:37.900455+0000","last_became_active":"2024-09-17T03:14:36.922875+0000","last_became_peered":"2024-09-17T03:14:36.922875+0000","last_unstale":"2024-09-17T03:14:37.900455+0000","last_undegraded":"2024-09-17T03:14:37.900455+0000","last_fullsized":"2024-09-17T03:14:37.900455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:26.793869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918123+0000","last_change":"2024-09-17T03:14:37.930593+0000","last_active":"2024-09-17T03:14:38.918123+0000","last_peered":"2024-09-17T03:14:38.918123+0000","last_clean":"2024-09-17T03:14:38.918123+0000","last_became_active":"2024-09-17T03:14:37.930249+0000","last_became_peered":"2024-09-17T03:14:37.930249+0000","last_unstale":"2024-09-17T03:14:38.918123+0000","last_undegraded":"2024-09-17T03:14:38.918123+0000","last_fullsized":"2024-09-17T03:14:38.918123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.975256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667593+0000","last_change":"2024-09-17T03:14:36.915113+0000","last_active":"2024-09-17T03:14:39.667593+0000","last_peered":"2024-09-17T03:14:39.667593+0000","last_clean":"2024-09-17T03:14:39.667593+0000","last_became_active":"2024-09-17T03:14:36.914812+0000","last_became_peered":"2024-09-17T03:14:36.914812+0000","last_unstale":"2024-09-17T03:14:39.667593+0000","last_undegraded":"2024-09-17T03:14:39.667593+0000","last_fullsized":"2024-09-17T03:14:39.667593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.229040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905311+0000","last_change":"2024-09-17T03:14:37.931554+0000","last_active":"2024-09-17T03:14:39.905311+0000","last_peered":"2024-09-17T03:14:39.905311+0000","last_clean":"2024-09-17T03:14:39.905311+0000","last_became_active":"2024-09-17T03:14:37.930825+0000","last_became_peered":"2024-09-17T03:14:37.930825+0000","last_unstale":"2024-09-17T03:14:39.905311+0000","last_undegraded":"2024-09-17T03:14:39.905311+0000","last_fullsized":"2024-09-17T03:14:39.905311+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:06.238924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917956+0000","last_change":"2024-09-17T03:14:36.922204+0000","last_active":"2024-09-17T03:14:38.917956+0000","last_peered":"2024-09-17T03:14:38.917956+0000","last_clean":"2024-09-17T03:14:38.917956+0000","last_became_active":"2024-09-17T03:14:36.921846+0000","last_became_peered":"2024-09-17T03:14:36.921846+0000","last_unstale":"2024-09-17T03:14:38.917956+0000","last_undegraded":"2024-09-17T03:14:38.917956+0000","last_fullsized":"2024-09-17T03:14:38.917956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:35.900648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888313+0000","last_change":"2024-09-17T03:14:37.924380+0000","last_active":"2024-09-17T03:14:39.888313+0000","last_peered":"2024-09-17T03:14:39.888313+0000","last_clean":"2024-09-17T03:14:39.888313+0000","last_became_active":"2024-09-17T03:14:37.924111+0000","last_became_peered":"2024-09-17T03:14:37.924111+0000","last_unstale":"2024-09-17T03:14:39.888313+0000","last_undegraded":"2024-09-17T03:14:39.888313+0000","last_fullsized":"2024-09-17T03:14:39.888313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:26.021459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917939+0000","last_change":"2024-09-17T03:14:36.921890+0000","last_active":"2024-09-17T03:14:38.917939+0000","last_peered":"2024-09-17T03:14:38.917939+0000","last_clean":"2024-09-17T03:14:38.917939+0000","last_became_active":"2024-09-17T03:14:36.921468+0000","last_became_peered":"2024-09-17T03:14:36.921468+0000","last_unstale":"2024-09-17T03:14:38.917939+0000","last_undegraded":"2024-09-17T03:14:38.917939+0000","last_fullsized":"2024-09-17T03:14:38.917939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917497+0000","last_change":"2024-09-17T03:14:37.938088+0000","last_active":"2024-09-17T03:14:38.917497+0000","last_peered":"2024-09-17T03:14:38.917497+0000","last_clean":"2024-09-17T03:14:38.917497+0000","last_became_active":"2024-09-17T03:14:37.937723+0000","last_became_peered":"2024-09-17T03:14:37.937723+0000","last_unstale":"2024-09-17T03:14:38.917497+0000","last_undegraded":"2024-09-17T03:14:38.917497+0000","last_fullsized":"2024-09-17T03:14:38.917497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:35.741738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919097+0000","last_change":"2024-09-17T03:14:36.917011+0000","last_active":"2024-09-17T03:14:38.919097+0000","last_peered":"2024-09-17T03:14:38.919097+0000","last_clean":"2024-09-17T03:14:38.919097+0000","last_became_active":"2024-09-17T03:14:36.916298+0000","last_became_peered":"2024-09-17T03:14:36.916298+0000","last_unstale":"2024-09-17T03:14:38.919097+0000","last_undegraded":"2024-09-17T03:14:38.919097+0000","last_fullsized":"2024-09-17T03:14:38.919097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:26.488733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:14:37.929687+0000","last_change":"2024-09-17T03:14:37.928215+0000","last_active":"2024-09-17T03:14:37.929687+0000","last_peered":"2024-09-17T03:14:37.929687+0000","last_clean":"2024-09-17T03:14:37.929687+0000","last_became_active":"2024-09-17T03:14:37.927665+0000","last_became_peered":"2024-09-17T03:14:37.927665+0000","last_unstale":"2024-09-17T03:14:37.929687+0000","last_undegraded":"2024-09-17T03:14:37.929687+0000","last_fullsized":"2024-09-17T03:14:37.929687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:45.439704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904813+0000","last_change":"2024-09-17T03:14:36.922835+0000","last_active":"2024-09-17T03:14:39.904813+0000","last_peered":"2024-09-17T03:14:39.904813+0000","last_clean":"2024-09-17T03:14:39.904813+0000","last_became_active":"2024-09-17T03:14:36.922217+0000","last_became_peered":"2024-09-17T03:14:36.922217+0000","last_unstale":"2024-09-17T03:14:39.904813+0000","last_undegraded":"2024-09-17T03:14:39.904813+0000","last_fullsized":"2024-09-17T03:14:39.904813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:59.651903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667640+0000","last_change":"2024-09-17T03:14:37.916054+0000","last_active":"2024-09-17T03:14:39.667640+0000","last_peered":"2024-09-17T03:14:39.667640+0000","last_clean":"2024-09-17T03:14:39.667640+0000","last_became_active":"2024-09-17T03:14:37.915360+0000","last_became_peered":"2024-09-17T03:14:37.915360+0000","last_unstale":"2024-09-17T03:14:39.667640+0000","last_undegraded":"2024-09-17T03:14:39.667640+0000","last_fullsized":"2024-09-17T03:14:39.667640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:12.876720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667264+0000","last_change":"2024-09-17T03:14:36.915925+0000","last_active":"2024-09-17T03:14:39.667264+0000","last_peered":"2024-09-17T03:14:39.667264+0000","last_clean":"2024-09-17T03:14:39.667264+0000","last_became_active":"2024-09-17T03:14:36.914802+0000","last_became_peered":"2024-09-17T03:14:36.914802+0000","last_unstale":"2024-09-17T03:14:39.667264+0000","last_undegraded":"2024-09-17T03:14:39.667264+0000","last_fullsized":"2024-09-17T03:14:39.667264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:55.918240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905091+0000","last_change":"2024-09-17T03:14:37.916882+0000","last_active":"2024-09-17T03:14:39.905091+0000","last_peered":"2024-09-17T03:14:39.905091+0000","last_clean":"2024-09-17T03:14:39.905091+0000","last_became_active":"2024-09-17T03:14:37.916570+0000","last_became_peered":"2024-09-17T03:14:37.916570+0000","last_unstale":"2024-09-17T03:14:39.905091+0000","last_undegraded":"2024-09-17T03:14:39.905091+0000","last_fullsized":"2024-09-17T03:14:39.905091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919520+0000","last_change":"2024-09-17T03:14:36.918082+0000","last_active":"2024-09-17T03:14:38.919520+0000","last_peered":"2024-09-17T03:14:38.919520+0000","last_clean":"2024-09-17T03:14:38.919520+0000","last_became_active":"2024-09-17T03:14:36.917391+0000","last_became_peered":"2024-09-17T03:14:36.917391+0000","last_unstale":"2024-09-17T03:14:38.919520+0000","last_undegraded":"2024-09-17T03:14:38.919520+0000","last_fullsized":"2024-09-17T03:14:38.919520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667521+0000","last_change":"2024-09-17T03:14:37.937637+0000","last_active":"2024-09-17T03:14:39.667521+0000","last_peered":"2024-09-17T03:14:39.667521+0000","last_clean":"2024-09-17T03:14:39.667521+0000","last_became_active":"2024-09-17T03:14:37.937349+0000","last_became_peered":"2024-09-17T03:14:37.937349+0000","last_unstale":"2024-09-17T03:14:39.667521+0000","last_undegraded":"2024-09-17T03:14:39.667521+0000","last_fullsized":"2024-09-17T03:14:39.667521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:49.312689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904741+0000","last_change":"2024-09-17T03:14:36.919006+0000","last_active":"2024-09-17T03:14:39.904741+0000","last_peered":"2024-09-17T03:14:39.904741+0000","last_clean":"2024-09-17T03:14:39.904741+0000","last_became_active":"2024-09-17T03:14:36.916543+0000","last_became_peered":"2024-09-17T03:14:36.916543+0000","last_unstale":"2024-09-17T03:14:39.904741+0000","last_undegraded":"2024-09-17T03:14:39.904741+0000","last_fullsized":"2024-09-17T03:14:39.904741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:46.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":144,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915414+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:14:38.915414+0000","last_peered":"2024-09-17T03:14:38.915414+0000","last_clean":"2024-09-17T03:14:38.915414+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:14:38.915414+0000","last_undegraded":"2024-09-17T03:14:38.915414+0000","last_fullsized":"2024-09-17T03:14:38.915414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":202451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":200807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:47.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:47.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 -- 172.21.15.153:0/2865748092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f440cbc10 msgr2=0x7f0f440cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2865748092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f440cbc10 0x7f0f440cc020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005fd0 tx=0x7f0f3002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 -- 172.21.15.153:0/2865748092 shutdown_connections 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2865748092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f440cbc10 0x7f0f440cc020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2865748092 >> v2:172.21.15.164:3300/0 conn(0x7f0f44074cb0 0x7f0f44073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 -- 172.21.15.153:0/2865748092 >> 172.21.15.153:0/2865748092 conn(0x7f0f440cca40 msgr2=0x7f0f440cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 -- 172.21.15.153:0/2865748092 shutdown_connections 2024-09-17T03:14:47.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.573+0000 7f0f4c400640 1 -- 172.21.15.153:0/2865748092 wait complete. 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.575+0000 7f0f4c400640 1 Processor -- start 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.575+0000 7f0f4c400640 1 -- start start 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f44074cb0 0x7f0f441f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f440cbc10 0x7f0f4409b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4406f360 con 0x7f0f4406ddf0 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4406f1e0 con 0x7f0f440cbc10 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4c400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4406f4e0 con 0x7f0f44074cb0 2024-09-17T03:14:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f49a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f49a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48352/0 (socket says 172.21.15.153:48352) 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f49a00640 1 -- 172.21.15.153:0/2354124127 learned_addr learned my addr 172.21.15.153:0/2354124127 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f49000640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f44074cb0 0x7f0f441f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.577+0000 7f0f4a400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f440cbc10 0x7f0f4409b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 -- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f44074cb0 msgr2=0x7f0f441f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f44074cb0 0x7f0f441f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 -- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f440cbc10 msgr2=0x7f0f4409b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f440cbc10 0x7f0f4409b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 -- 172.21.15.153:0/2354124127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4409d420 con 0x7f0f4406ddf0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f49a00640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800e790 tx=0x7f0f3800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800eea0 con 0x7f0f4406ddf0 2024-09-17T03:14:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f441f6b90 con 0x7f0f4406ddf0 2024-09-17T03:14:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f3800ccc0 con 0x7f0f4406ddf0 2024-09-17T03:14:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38004280 con 0x7f0f4406ddf0 2024-09-17T03:14:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.578+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f441f6f30 con 0x7f0f4406ddf0 2024-09-17T03:14:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.579+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4409d8d0 con 0x7f0f4406ddf0 2024-09-17T03:14:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.581+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f380035f0 con 0x7f0f4406ddf0 2024-09-17T03:14:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.582+0000 7f0f41600640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 0x7f0f2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.582+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f0f3809b950 con 0x7f0f4406ddf0 2024-09-17T03:14:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.583+0000 7f0f49000640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 0x7f0f2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.583+0000 7f0f49000640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 0x7f0f2407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f30033000 tx=0x7f0f30004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.587+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f4409d8d0 con 0x7f0f4406ddf0 2024-09-17T03:14:47.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.769+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f4415ed30 con 0x7f0f24078b90 2024-09-17T03:14:47.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.774+0000 7f0f41600640 1 -- 172.21.15.153:0/2354124127 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251858 (secure 0 0 0) 0x7f0f300055e0 con 0x7f0f24078b90 2024-09-17T03:14:47.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:47.778 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:14:47.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 msgr2=0x7f0f2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 0x7f0f2407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f30033000 tx=0x7f0f30004730 comp rx=0 tx=0).stop 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 msgr2=0x7f0f440a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800e790 tx=0x7f0f3800ec50 comp rx=0 tx=0).stop 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 shutdown_connections 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0f24078b90 0x7f0f2407b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0f440cbc10 0x7f0f4409b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0f44074cb0 0x7f0f441f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 --2- 172.21.15.153:0/2354124127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f4406ddf0 0x7f0f440a08b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.778+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 >> 172.21.15.153:0/2354124127 conn(0x7f0f440cca40 msgr2=0x7f0f440cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.779+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 shutdown_connections 2024-09-17T03:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:47.779+0000 7f0f4c400640 1 -- 172.21.15.153:0/2354124127 wait complete. 2024-09-17T03:14:47.802 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-17T03:14:46.836081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221112,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753608,"statfs":{"total":773094113280,"available":772867694592,"internally_reserved":0,"allocated":4988928,"data_stored":2791276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.940008"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919963+0000","last_change":"2024-09-17T03:14:37.916561+0000","last_active":"2024-09-17T03:14:38.919963+0000","last_peered":"2024-09-17T03:14:38.919963+0000","last_clean":"2024-09-17T03:14:38.919963+0000","last_became_active":"2024-09-17T03:14:37.916223+0000","last_became_peered":"2024-09-17T03:14:37.916223+0000","last_unstale":"2024-09-17T03:14:38.919963+0000","last_undegraded":"2024-09-17T03:14:38.919963+0000","last_fullsized":"2024-09-17T03:14:38.919963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:08.134288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248740+0000","last_change":"2024-09-17T03:14:37.918478+0000","last_active":"2024-09-17T03:14:40.248740+0000","last_peered":"2024-09-17T03:14:40.248740+0000","last_clean":"2024-09-17T03:14:40.248740+0000","last_became_active":"2024-09-17T03:14:37.918150+0000","last_became_peered":"2024-09-17T03:14:37.918150+0000","last_unstale":"2024-09-17T03:14:40.248740+0000","last_undegraded":"2024-09-17T03:14:40.248740+0000","last_fullsized":"2024-09-17T03:14:40.248740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:38.738859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919826+0000","last_change":"2024-09-17T03:14:37.918446+0000","last_active":"2024-09-17T03:14:38.919826+0000","last_peered":"2024-09-17T03:14:38.919826+0000","last_clean":"2024-09-17T03:14:38.919826+0000","last_became_active":"2024-09-17T03:14:37.911192+0000","last_became_peered":"2024-09-17T03:14:37.911192+0000","last_unstale":"2024-09-17T03:14:38.919826+0000","last_undegraded":"2024-09-17T03:14:38.919826+0000","last_fullsized":"2024-09-17T03:14:38.919826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:32.884580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919292+0000","last_change":"2024-09-17T03:14:37.925347+0000","last_active":"2024-09-17T03:14:38.919292+0000","last_peered":"2024-09-17T03:14:38.919292+0000","last_clean":"2024-09-17T03:14:38.919292+0000","last_became_active":"2024-09-17T03:14:37.924709+0000","last_became_peered":"2024-09-17T03:14:37.924709+0000","last_unstale":"2024-09-17T03:14:38.919292+0000","last_undegraded":"2024-09-17T03:14:38.919292+0000","last_fullsized":"2024-09-17T03:14:38.919292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:36.973784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917716+0000","last_change":"2024-09-17T03:14:37.935833+0000","last_active":"2024-09-17T03:14:38.917716+0000","last_peered":"2024-09-17T03:14:38.917716+0000","last_clean":"2024-09-17T03:14:38.917716+0000","last_became_active":"2024-09-17T03:14:37.935518+0000","last_became_peered":"2024-09-17T03:14:37.935518+0000","last_unstale":"2024-09-17T03:14:38.917716+0000","last_undegraded":"2024-09-17T03:14:38.917716+0000","last_fullsized":"2024-09-17T03:14:38.917716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:55.741697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248586+0000","last_change":"2024-09-17T03:14:37.910208+0000","last_active":"2024-09-17T03:14:40.248586+0000","last_peered":"2024-09-17T03:14:40.248586+0000","last_clean":"2024-09-17T03:14:40.248586+0000","last_became_active":"2024-09-17T03:14:37.909810+0000","last_became_peered":"2024-09-17T03:14:37.909810+0000","last_unstale":"2024-09-17T03:14:40.248586+0000","last_undegraded":"2024-09-17T03:14:40.248586+0000","last_fullsized":"2024-09-17T03:14:40.248586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:31.597623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915499+0000","last_change":"2024-09-17T03:14:37.921919+0000","last_active":"2024-09-17T03:14:38.915499+0000","last_peered":"2024-09-17T03:14:38.915499+0000","last_clean":"2024-09-17T03:14:38.915499+0000","last_became_active":"2024-09-17T03:14:37.921605+0000","last_became_peered":"2024-09-17T03:14:37.921605+0000","last_unstale":"2024-09-17T03:14:38.915499+0000","last_undegraded":"2024-09-17T03:14:38.915499+0000","last_fullsized":"2024-09-17T03:14:38.915499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:04.482880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918503+0000","last_change":"2024-09-17T03:14:37.929874+0000","last_active":"2024-09-17T03:14:38.918503+0000","last_peered":"2024-09-17T03:14:38.918503+0000","last_clean":"2024-09-17T03:14:38.918503+0000","last_became_active":"2024-09-17T03:14:37.929183+0000","last_became_peered":"2024-09-17T03:14:37.929183+0000","last_unstale":"2024-09-17T03:14:38.918503+0000","last_undegraded":"2024-09-17T03:14:38.918503+0000","last_fullsized":"2024-09-17T03:14:38.918503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:07.984867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918320+0000","last_change":"2024-09-17T03:14:37.942264+0000","last_active":"2024-09-17T03:14:38.918320+0000","last_peered":"2024-09-17T03:14:38.918320+0000","last_clean":"2024-09-17T03:14:38.918320+0000","last_became_active":"2024-09-17T03:14:37.942048+0000","last_became_peered":"2024-09-17T03:14:37.942048+0000","last_unstale":"2024-09-17T03:14:38.918320+0000","last_undegraded":"2024-09-17T03:14:38.918320+0000","last_fullsized":"2024-09-17T03:14:38.918320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:47.951479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916140+0000","last_change":"2024-09-17T03:14:37.925527+0000","last_active":"2024-09-17T03:14:38.916140+0000","last_peered":"2024-09-17T03:14:38.916140+0000","last_clean":"2024-09-17T03:14:38.916140+0000","last_became_active":"2024-09-17T03:14:37.925210+0000","last_became_peered":"2024-09-17T03:14:37.925210+0000","last_unstale":"2024-09-17T03:14:38.916140+0000","last_undegraded":"2024-09-17T03:14:38.916140+0000","last_fullsized":"2024-09-17T03:14:38.916140+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:22.863410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905176+0000","last_change":"2024-09-17T03:14:37.933221+0000","last_active":"2024-09-17T03:14:39.905176+0000","last_peered":"2024-09-17T03:14:39.905176+0000","last_clean":"2024-09-17T03:14:39.905176+0000","last_became_active":"2024-09-17T03:14:37.931240+0000","last_became_peered":"2024-09-17T03:14:37.931240+0000","last_unstale":"2024-09-17T03:14:39.905176+0000","last_undegraded":"2024-09-17T03:14:39.905176+0000","last_fullsized":"2024-09-17T03:14:39.905176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:54.899035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918082+0000","last_change":"2024-09-17T03:14:37.928051+0000","last_active":"2024-09-17T03:14:38.918082+0000","last_peered":"2024-09-17T03:14:38.918082+0000","last_clean":"2024-09-17T03:14:38.918082+0000","last_became_active":"2024-09-17T03:14:37.927608+0000","last_became_peered":"2024-09-17T03:14:37.927608+0000","last_unstale":"2024-09-17T03:14:38.918082+0000","last_undegraded":"2024-09-17T03:14:38.918082+0000","last_fullsized":"2024-09-17T03:14:38.918082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:48.723198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915524+0000","last_change":"2024-09-17T03:14:37.916003+0000","last_active":"2024-09-17T03:14:38.915524+0000","last_peered":"2024-09-17T03:14:38.915524+0000","last_clean":"2024-09-17T03:14:38.915524+0000","last_became_active":"2024-09-17T03:14:37.915694+0000","last_became_peered":"2024-09-17T03:14:37.915694+0000","last_unstale":"2024-09-17T03:14:38.915524+0000","last_undegraded":"2024-09-17T03:14:38.915524+0000","last_fullsized":"2024-09-17T03:14:38.915524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:46.763114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247901+0000","last_change":"2024-09-17T03:14:37.923019+0000","last_active":"2024-09-17T03:14:40.247901+0000","last_peered":"2024-09-17T03:14:40.247901+0000","last_clean":"2024-09-17T03:14:40.247901+0000","last_became_active":"2024-09-17T03:14:37.922617+0000","last_became_peered":"2024-09-17T03:14:37.922617+0000","last_unstale":"2024-09-17T03:14:40.247901+0000","last_undegraded":"2024-09-17T03:14:40.247901+0000","last_fullsized":"2024-09-17T03:14:40.247901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:14.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.666997+0000","last_change":"2024-09-17T03:14:37.921909+0000","last_active":"2024-09-17T03:14:39.666997+0000","last_peered":"2024-09-17T03:14:39.666997+0000","last_clean":"2024-09-17T03:14:39.666997+0000","last_became_active":"2024-09-17T03:14:37.921309+0000","last_became_peered":"2024-09-17T03:14:37.921309+0000","last_unstale":"2024-09-17T03:14:39.666997+0000","last_undegraded":"2024-09-17T03:14:39.666997+0000","last_fullsized":"2024-09-17T03:14:39.666997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:05.255693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915715+0000","last_change":"2024-09-17T03:14:37.914801+0000","last_active":"2024-09-17T03:14:38.915715+0000","last_peered":"2024-09-17T03:14:38.915715+0000","last_clean":"2024-09-17T03:14:38.915715+0000","last_became_active":"2024-09-17T03:14:37.914491+0000","last_became_peered":"2024-09-17T03:14:37.914491+0000","last_unstale":"2024-09-17T03:14:38.915715+0000","last_undegraded":"2024-09-17T03:14:38.915715+0000","last_fullsized":"2024-09-17T03:14:38.915715+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:20.802554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667600+0000","last_change":"2024-09-17T03:14:37.937593+0000","last_active":"2024-09-17T03:14:39.667600+0000","last_peered":"2024-09-17T03:14:39.667600+0000","last_clean":"2024-09-17T03:14:39.667600+0000","last_became_active":"2024-09-17T03:14:37.937342+0000","last_became_peered":"2024-09-17T03:14:37.937342+0000","last_unstale":"2024-09-17T03:14:39.667600+0000","last_undegraded":"2024-09-17T03:14:39.667600+0000","last_fullsized":"2024-09-17T03:14:39.667600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:23.222179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667556+0000","last_change":"2024-09-17T03:14:37.934795+0000","last_active":"2024-09-17T03:14:39.667556+0000","last_peered":"2024-09-17T03:14:39.667556+0000","last_clean":"2024-09-17T03:14:39.667556+0000","last_became_active":"2024-09-17T03:14:37.934439+0000","last_became_peered":"2024-09-17T03:14:37.934439+0000","last_unstale":"2024-09-17T03:14:39.667556+0000","last_undegraded":"2024-09-17T03:14:39.667556+0000","last_fullsized":"2024-09-17T03:14:39.667556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:52.920067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888271+0000","last_change":"2024-09-17T03:14:37.915377+0000","last_active":"2024-09-17T03:14:39.888271+0000","last_peered":"2024-09-17T03:14:39.888271+0000","last_clean":"2024-09-17T03:14:39.888271+0000","last_became_active":"2024-09-17T03:14:37.914255+0000","last_became_peered":"2024-09-17T03:14:37.914255+0000","last_unstale":"2024-09-17T03:14:39.888271+0000","last_undegraded":"2024-09-17T03:14:39.888271+0000","last_fullsized":"2024-09-17T03:14:39.888271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:44.283334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904963+0000","last_change":"2024-09-17T03:14:37.924877+0000","last_active":"2024-09-17T03:14:39.904963+0000","last_peered":"2024-09-17T03:14:39.904963+0000","last_clean":"2024-09-17T03:14:39.904963+0000","last_became_active":"2024-09-17T03:14:37.924524+0000","last_became_peered":"2024-09-17T03:14:37.924524+0000","last_unstale":"2024-09-17T03:14:39.904963+0000","last_undegraded":"2024-09-17T03:14:39.904963+0000","last_fullsized":"2024-09-17T03:14:39.904963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:59.046870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904797+0000","last_change":"2024-09-17T03:14:37.934335+0000","last_active":"2024-09-17T03:14:39.904797+0000","last_peered":"2024-09-17T03:14:39.904797+0000","last_clean":"2024-09-17T03:14:39.904797+0000","last_became_active":"2024-09-17T03:14:37.934087+0000","last_became_peered":"2024-09-17T03:14:37.934087+0000","last_unstale":"2024-09-17T03:14:39.904797+0000","last_undegraded":"2024-09-17T03:14:39.904797+0000","last_fullsized":"2024-09-17T03:14:39.904797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:00.601596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904716+0000","last_change":"2024-09-17T03:14:37.931737+0000","last_active":"2024-09-17T03:14:39.904716+0000","last_peered":"2024-09-17T03:14:39.904716+0000","last_clean":"2024-09-17T03:14:39.904716+0000","last_became_active":"2024-09-17T03:14:37.931268+0000","last_became_peered":"2024-09-17T03:14:37.931268+0000","last_unstale":"2024-09-17T03:14:39.904716+0000","last_undegraded":"2024-09-17T03:14:39.904716+0000","last_fullsized":"2024-09-17T03:14:39.904716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:25.010704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667042+0000","last_change":"2024-09-17T03:14:37.918889+0000","last_active":"2024-09-17T03:14:39.667042+0000","last_peered":"2024-09-17T03:14:39.667042+0000","last_clean":"2024-09-17T03:14:39.667042+0000","last_became_active":"2024-09-17T03:14:37.918600+0000","last_became_peered":"2024-09-17T03:14:37.918600+0000","last_unstale":"2024-09-17T03:14:39.667042+0000","last_undegraded":"2024-09-17T03:14:39.667042+0000","last_fullsized":"2024-09-17T03:14:39.667042+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.718131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918713+0000","last_change":"2024-09-17T03:14:37.925187+0000","last_active":"2024-09-17T03:14:38.918713+0000","last_peered":"2024-09-17T03:14:38.918713+0000","last_clean":"2024-09-17T03:14:38.918713+0000","last_became_active":"2024-09-17T03:14:37.921554+0000","last_became_peered":"2024-09-17T03:14:37.921554+0000","last_unstale":"2024-09-17T03:14:38.918713+0000","last_undegraded":"2024-09-17T03:14:38.918713+0000","last_fullsized":"2024-09-17T03:14:38.918713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:00.487725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248111+0000","last_change":"2024-09-17T03:14:37.918971+0000","last_active":"2024-09-17T03:14:40.248111+0000","last_peered":"2024-09-17T03:14:40.248111+0000","last_clean":"2024-09-17T03:14:40.248111+0000","last_became_active":"2024-09-17T03:14:37.918667+0000","last_became_peered":"2024-09-17T03:14:37.918667+0000","last_unstale":"2024-09-17T03:14:40.248111+0000","last_undegraded":"2024-09-17T03:14:40.248111+0000","last_fullsized":"2024-09-17T03:14:40.248111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:39.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919882+0000","last_change":"2024-09-17T03:14:37.914820+0000","last_active":"2024-09-17T03:14:38.919882+0000","last_peered":"2024-09-17T03:14:38.919882+0000","last_clean":"2024-09-17T03:14:38.919882+0000","last_became_active":"2024-09-17T03:14:37.914525+0000","last_became_peered":"2024-09-17T03:14:37.914525+0000","last_unstale":"2024-09-17T03:14:38.919882+0000","last_undegraded":"2024-09-17T03:14:38.919882+0000","last_fullsized":"2024-09-17T03:14:38.919882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:02.988944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905289+0000","last_change":"2024-09-17T03:14:37.937272+0000","last_active":"2024-09-17T03:14:39.905289+0000","last_peered":"2024-09-17T03:14:39.905289+0000","last_clean":"2024-09-17T03:14:39.905289+0000","last_became_active":"2024-09-17T03:14:37.929899+0000","last_became_peered":"2024-09-17T03:14:37.929899+0000","last_unstale":"2024-09-17T03:14:39.905289+0000","last_undegraded":"2024-09-17T03:14:39.905289+0000","last_fullsized":"2024-09-17T03:14:39.905289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:45.514112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916045+0000","last_change":"2024-09-17T03:14:37.908890+0000","last_active":"2024-09-17T03:14:38.916045+0000","last_peered":"2024-09-17T03:14:38.916045+0000","last_clean":"2024-09-17T03:14:38.916045+0000","last_became_active":"2024-09-17T03:14:37.908582+0000","last_became_peered":"2024-09-17T03:14:37.908582+0000","last_unstale":"2024-09-17T03:14:38.916045+0000","last_undegraded":"2024-09-17T03:14:38.916045+0000","last_fullsized":"2024-09-17T03:14:38.916045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:46.004166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667433+0000","last_change":"2024-09-17T03:14:37.918649+0000","last_active":"2024-09-17T03:14:39.667433+0000","last_peered":"2024-09-17T03:14:39.667433+0000","last_clean":"2024-09-17T03:14:39.667433+0000","last_became_active":"2024-09-17T03:14:37.914911+0000","last_became_peered":"2024-09-17T03:14:37.914911+0000","last_unstale":"2024-09-17T03:14:39.667433+0000","last_undegraded":"2024-09-17T03:14:39.667433+0000","last_fullsized":"2024-09-17T03:14:39.667433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:43.998632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667101+0000","last_change":"2024-09-17T03:14:37.932532+0000","last_active":"2024-09-17T03:14:39.667101+0000","last_peered":"2024-09-17T03:14:39.667101+0000","last_clean":"2024-09-17T03:14:39.667101+0000","last_became_active":"2024-09-17T03:14:37.931864+0000","last_became_peered":"2024-09-17T03:14:37.931864+0000","last_unstale":"2024-09-17T03:14:39.667101+0000","last_undegraded":"2024-09-17T03:14:39.667101+0000","last_fullsized":"2024-09-17T03:14:39.667101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:45.580381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915497+0000","last_change":"2024-09-17T03:14:37.910258+0000","last_active":"2024-09-17T03:14:38.915497+0000","last_peered":"2024-09-17T03:14:38.915497+0000","last_clean":"2024-09-17T03:14:38.915497+0000","last_became_active":"2024-09-17T03:14:37.909949+0000","last_became_peered":"2024-09-17T03:14:37.909949+0000","last_unstale":"2024-09-17T03:14:38.915497+0000","last_undegraded":"2024-09-17T03:14:38.915497+0000","last_fullsized":"2024-09-17T03:14:38.915497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:23.024922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918936+0000","last_change":"2024-09-17T03:14:37.929536+0000","last_active":"2024-09-17T03:14:38.918936+0000","last_peered":"2024-09-17T03:14:38.918936+0000","last_clean":"2024-09-17T03:14:38.918936+0000","last_became_active":"2024-09-17T03:14:37.924822+0000","last_became_peered":"2024-09-17T03:14:37.924822+0000","last_unstale":"2024-09-17T03:14:38.918936+0000","last_undegraded":"2024-09-17T03:14:38.918936+0000","last_fullsized":"2024-09-17T03:14:38.918936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:00.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667368+0000","last_change":"2024-09-17T03:14:37.922333+0000","last_active":"2024-09-17T03:14:39.667368+0000","last_peered":"2024-09-17T03:14:39.667368+0000","last_clean":"2024-09-17T03:14:39.667368+0000","last_became_active":"2024-09-17T03:14:37.919774+0000","last_became_peered":"2024-09-17T03:14:37.919774+0000","last_unstale":"2024-09-17T03:14:39.667368+0000","last_undegraded":"2024-09-17T03:14:39.667368+0000","last_fullsized":"2024-09-17T03:14:39.667368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:29.964627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248024+0000","last_change":"2024-09-17T03:14:36.919459+0000","last_active":"2024-09-17T03:14:40.248024+0000","last_peered":"2024-09-17T03:14:40.248024+0000","last_clean":"2024-09-17T03:14:40.248024+0000","last_became_active":"2024-09-17T03:14:36.919157+0000","last_became_peered":"2024-09-17T03:14:36.919157+0000","last_unstale":"2024-09-17T03:14:40.248024+0000","last_undegraded":"2024-09-17T03:14:40.248024+0000","last_fullsized":"2024-09-17T03:14:40.248024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:03.170093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248840+0000","last_change":"2024-09-17T03:14:37.912463+0000","last_active":"2024-09-17T03:14:40.248840+0000","last_peered":"2024-09-17T03:14:40.248840+0000","last_clean":"2024-09-17T03:14:40.248840+0000","last_became_active":"2024-09-17T03:14:37.912103+0000","last_became_peered":"2024-09-17T03:14:37.912103+0000","last_unstale":"2024-09-17T03:14:40.248840+0000","last_undegraded":"2024-09-17T03:14:40.248840+0000","last_fullsized":"2024-09-17T03:14:40.248840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:44.880260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248990+0000","last_change":"2024-09-17T03:14:36.914189+0000","last_active":"2024-09-17T03:14:40.248990+0000","last_peered":"2024-09-17T03:14:40.248990+0000","last_clean":"2024-09-17T03:14:40.248990+0000","last_became_active":"2024-09-17T03:14:36.913759+0000","last_became_peered":"2024-09-17T03:14:36.913759+0000","last_unstale":"2024-09-17T03:14:40.248990+0000","last_undegraded":"2024-09-17T03:14:40.248990+0000","last_fullsized":"2024-09-17T03:14:40.248990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667500+0000","last_change":"2024-09-17T03:14:37.921729+0000","last_active":"2024-09-17T03:14:39.667500+0000","last_peered":"2024-09-17T03:14:39.667500+0000","last_clean":"2024-09-17T03:14:39.667500+0000","last_became_active":"2024-09-17T03:14:37.921290+0000","last_became_peered":"2024-09-17T03:14:37.921290+0000","last_unstale":"2024-09-17T03:14:39.667500+0000","last_undegraded":"2024-09-17T03:14:39.667500+0000","last_fullsized":"2024-09-17T03:14:39.667500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:22.375459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919802+0000","last_change":"2024-09-17T03:14:36.915336+0000","last_active":"2024-09-17T03:14:38.919802+0000","last_peered":"2024-09-17T03:14:38.919802+0000","last_clean":"2024-09-17T03:14:38.919802+0000","last_became_active":"2024-09-17T03:14:36.914976+0000","last_became_peered":"2024-09-17T03:14:36.914976+0000","last_unstale":"2024-09-17T03:14:38.919802+0000","last_undegraded":"2024-09-17T03:14:38.919802+0000","last_fullsized":"2024-09-17T03:14:38.919802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:43.593532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.249075+0000","last_change":"2024-09-17T03:14:37.929582+0000","last_active":"2024-09-17T03:14:40.249075+0000","last_peered":"2024-09-17T03:14:40.249075+0000","last_clean":"2024-09-17T03:14:40.249075+0000","last_became_active":"2024-09-17T03:14:37.929244+0000","last_became_peered":"2024-09-17T03:14:37.929244+0000","last_unstale":"2024-09-17T03:14:40.249075+0000","last_undegraded":"2024-09-17T03:14:40.249075+0000","last_fullsized":"2024-09-17T03:14:40.249075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:03.358550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247778+0000","last_change":"2024-09-17T03:14:36.923785+0000","last_active":"2024-09-17T03:14:40.247778+0000","last_peered":"2024-09-17T03:14:40.247778+0000","last_clean":"2024-09-17T03:14:40.247778+0000","last_became_active":"2024-09-17T03:14:36.923407+0000","last_became_peered":"2024-09-17T03:14:36.923407+0000","last_unstale":"2024-09-17T03:14:40.247778+0000","last_undegraded":"2024-09-17T03:14:40.247778+0000","last_fullsized":"2024-09-17T03:14:40.247778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:19.669130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919184+0000","last_change":"2024-09-17T03:14:37.935225+0000","last_active":"2024-09-17T03:14:38.919184+0000","last_peered":"2024-09-17T03:14:38.919184+0000","last_clean":"2024-09-17T03:14:38.919184+0000","last_became_active":"2024-09-17T03:14:37.934527+0000","last_became_peered":"2024-09-17T03:14:37.934527+0000","last_unstale":"2024-09-17T03:14:38.919184+0000","last_undegraded":"2024-09-17T03:14:38.919184+0000","last_fullsized":"2024-09-17T03:14:38.919184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:00.004933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247756+0000","last_change":"2024-09-17T03:14:36.918145+0000","last_active":"2024-09-17T03:14:40.247756+0000","last_peered":"2024-09-17T03:14:40.247756+0000","last_clean":"2024-09-17T03:14:40.247756+0000","last_became_active":"2024-09-17T03:14:36.917775+0000","last_became_peered":"2024-09-17T03:14:36.917775+0000","last_unstale":"2024-09-17T03:14:40.247756+0000","last_undegraded":"2024-09-17T03:14:40.247756+0000","last_fullsized":"2024-09-17T03:14:40.247756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:57.115028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904752+0000","last_change":"2024-09-17T03:14:37.928437+0000","last_active":"2024-09-17T03:14:39.904752+0000","last_peered":"2024-09-17T03:14:39.904752+0000","last_clean":"2024-09-17T03:14:39.904752+0000","last_became_active":"2024-09-17T03:14:37.928129+0000","last_became_peered":"2024-09-17T03:14:37.928129+0000","last_unstale":"2024-09-17T03:14:39.904752+0000","last_undegraded":"2024-09-17T03:14:39.904752+0000","last_fullsized":"2024-09-17T03:14:39.904752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:38.645776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915486+0000","last_change":"2024-09-17T03:14:36.919059+0000","last_active":"2024-09-17T03:14:38.915486+0000","last_peered":"2024-09-17T03:14:38.915486+0000","last_clean":"2024-09-17T03:14:38.915486+0000","last_became_active":"2024-09-17T03:14:36.918746+0000","last_became_peered":"2024-09-17T03:14:36.918746+0000","last_unstale":"2024-09-17T03:14:38.915486+0000","last_undegraded":"2024-09-17T03:14:38.915486+0000","last_fullsized":"2024-09-17T03:14:38.915486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:59.611828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667169+0000","last_change":"2024-09-17T03:14:37.932207+0000","last_active":"2024-09-17T03:14:39.667169+0000","last_peered":"2024-09-17T03:14:39.667169+0000","last_clean":"2024-09-17T03:14:39.667169+0000","last_became_active":"2024-09-17T03:14:37.931501+0000","last_became_peered":"2024-09-17T03:14:37.931501+0000","last_unstale":"2024-09-17T03:14:39.667169+0000","last_undegraded":"2024-09-17T03:14:39.667169+0000","last_fullsized":"2024-09-17T03:14:39.667169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:11.603444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917655+0000","last_change":"2024-09-17T03:14:36.925978+0000","last_active":"2024-09-17T03:14:38.917655+0000","last_peered":"2024-09-17T03:14:38.917655+0000","last_clean":"2024-09-17T03:14:38.917655+0000","last_became_active":"2024-09-17T03:14:36.925675+0000","last_became_peered":"2024-09-17T03:14:36.925675+0000","last_unstale":"2024-09-17T03:14:38.917655+0000","last_undegraded":"2024-09-17T03:14:38.917655+0000","last_fullsized":"2024-09-17T03:14:38.917655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:51.069808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248869+0000","last_change":"2024-09-17T03:14:37.927188+0000","last_active":"2024-09-17T03:14:40.248869+0000","last_peered":"2024-09-17T03:14:40.248869+0000","last_clean":"2024-09-17T03:14:40.248869+0000","last_became_active":"2024-09-17T03:14:37.923498+0000","last_became_peered":"2024-09-17T03:14:37.923498+0000","last_unstale":"2024-09-17T03:14:40.248869+0000","last_undegraded":"2024-09-17T03:14:40.248869+0000","last_fullsized":"2024-09-17T03:14:40.248869+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:54.434373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915284+0000","last_change":"2024-09-17T03:14:36.912696+0000","last_active":"2024-09-17T03:14:38.915284+0000","last_peered":"2024-09-17T03:14:38.915284+0000","last_clean":"2024-09-17T03:14:38.915284+0000","last_became_active":"2024-09-17T03:14:36.912364+0000","last_became_peered":"2024-09-17T03:14:36.912364+0000","last_unstale":"2024-09-17T03:14:38.915284+0000","last_undegraded":"2024-09-17T03:14:38.915284+0000","last_fullsized":"2024-09-17T03:14:38.915284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:41.054162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919396+0000","last_change":"2024-09-17T03:14:37.925010+0000","last_active":"2024-09-17T03:14:38.919396+0000","last_peered":"2024-09-17T03:14:38.919396+0000","last_clean":"2024-09-17T03:14:38.919396+0000","last_became_active":"2024-09-17T03:14:37.924289+0000","last_became_peered":"2024-09-17T03:14:37.924289+0000","last_unstale":"2024-09-17T03:14:38.919396+0000","last_undegraded":"2024-09-17T03:14:38.919396+0000","last_fullsized":"2024-09-17T03:14:38.919396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.128576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.920023+0000","last_change":"2024-09-17T03:14:36.918393+0000","last_active":"2024-09-17T03:14:38.920023+0000","last_peered":"2024-09-17T03:14:38.920023+0000","last_clean":"2024-09-17T03:14:38.920023+0000","last_became_active":"2024-09-17T03:14:36.918003+0000","last_became_peered":"2024-09-17T03:14:36.918003+0000","last_unstale":"2024-09-17T03:14:38.920023+0000","last_undegraded":"2024-09-17T03:14:38.920023+0000","last_fullsized":"2024-09-17T03:14:38.920023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:45.151063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248033+0000","last_change":"2024-09-17T03:14:37.924828+0000","last_active":"2024-09-17T03:14:40.248033+0000","last_peered":"2024-09-17T03:14:40.248033+0000","last_clean":"2024-09-17T03:14:40.248033+0000","last_became_active":"2024-09-17T03:14:37.917570+0000","last_became_peered":"2024-09-17T03:14:37.917570+0000","last_unstale":"2024-09-17T03:14:40.248033+0000","last_undegraded":"2024-09-17T03:14:40.248033+0000","last_fullsized":"2024-09-17T03:14:40.248033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:27.498618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667189+0000","last_change":"2024-09-17T03:14:36.918369+0000","last_active":"2024-09-17T03:14:39.667189+0000","last_peered":"2024-09-17T03:14:39.667189+0000","last_clean":"2024-09-17T03:14:39.667189+0000","last_became_active":"2024-09-17T03:14:36.918103+0000","last_became_peered":"2024-09-17T03:14:36.918103+0000","last_unstale":"2024-09-17T03:14:39.667189+0000","last_undegraded":"2024-09-17T03:14:39.667189+0000","last_fullsized":"2024-09-17T03:14:39.667189+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:29.198060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919959+0000","last_change":"2024-09-17T03:14:37.919968+0000","last_active":"2024-09-17T03:14:38.919959+0000","last_peered":"2024-09-17T03:14:38.919959+0000","last_clean":"2024-09-17T03:14:38.919959+0000","last_became_active":"2024-09-17T03:14:37.919606+0000","last_became_peered":"2024-09-17T03:14:37.919606+0000","last_unstale":"2024-09-17T03:14:38.919959+0000","last_undegraded":"2024-09-17T03:14:38.919959+0000","last_fullsized":"2024-09-17T03:14:38.919959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:29.688951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667040+0000","last_change":"2024-09-17T03:14:36.922737+0000","last_active":"2024-09-17T03:14:39.667040+0000","last_peered":"2024-09-17T03:14:39.667040+0000","last_clean":"2024-09-17T03:14:39.667040+0000","last_became_active":"2024-09-17T03:14:36.922473+0000","last_became_peered":"2024-09-17T03:14:36.922473+0000","last_unstale":"2024-09-17T03:14:39.667040+0000","last_undegraded":"2024-09-17T03:14:39.667040+0000","last_fullsized":"2024-09-17T03:14:39.667040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:01.501489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916734+0000","last_change":"2024-09-17T03:14:37.922491+0000","last_active":"2024-09-17T03:14:38.916734+0000","last_peered":"2024-09-17T03:14:38.916734+0000","last_clean":"2024-09-17T03:14:38.916734+0000","last_became_active":"2024-09-17T03:14:37.922210+0000","last_became_peered":"2024-09-17T03:14:37.922210+0000","last_unstale":"2024-09-17T03:14:38.916734+0000","last_undegraded":"2024-09-17T03:14:38.916734+0000","last_fullsized":"2024-09-17T03:14:38.916734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:45.166992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919354+0000","last_change":"2024-09-17T03:14:36.920649+0000","last_active":"2024-09-17T03:14:38.919354+0000","last_peered":"2024-09-17T03:14:38.919354+0000","last_clean":"2024-09-17T03:14:38.919354+0000","last_became_active":"2024-09-17T03:14:36.920336+0000","last_became_peered":"2024-09-17T03:14:36.920336+0000","last_unstale":"2024-09-17T03:14:38.919354+0000","last_undegraded":"2024-09-17T03:14:38.919354+0000","last_fullsized":"2024-09-17T03:14:38.919354+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:40.796766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919439+0000","last_change":"2024-09-17T03:14:37.925567+0000","last_active":"2024-09-17T03:14:38.919439+0000","last_peered":"2024-09-17T03:14:38.919439+0000","last_clean":"2024-09-17T03:14:38.919439+0000","last_became_active":"2024-09-17T03:14:37.924189+0000","last_became_peered":"2024-09-17T03:14:37.924189+0000","last_unstale":"2024-09-17T03:14:38.919439+0000","last_undegraded":"2024-09-17T03:14:38.919439+0000","last_fullsized":"2024-09-17T03:14:38.919439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:27.639246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918927+0000","last_change":"2024-09-17T03:14:36.915616+0000","last_active":"2024-09-17T03:14:38.918927+0000","last_peered":"2024-09-17T03:14:38.918927+0000","last_clean":"2024-09-17T03:14:38.918927+0000","last_became_active":"2024-09-17T03:14:36.915341+0000","last_became_peered":"2024-09-17T03:14:36.915341+0000","last_unstale":"2024-09-17T03:14:38.918927+0000","last_undegraded":"2024-09-17T03:14:38.918927+0000","last_fullsized":"2024-09-17T03:14:38.918927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:13.253503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248629+0000","last_change":"2024-09-17T03:14:37.913219+0000","last_active":"2024-09-17T03:14:40.248629+0000","last_peered":"2024-09-17T03:14:40.248629+0000","last_clean":"2024-09-17T03:14:40.248629+0000","last_became_active":"2024-09-17T03:14:37.912848+0000","last_became_peered":"2024-09-17T03:14:37.912848+0000","last_unstale":"2024-09-17T03:14:40.248629+0000","last_undegraded":"2024-09-17T03:14:40.248629+0000","last_fullsized":"2024-09-17T03:14:40.248629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:28.944943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248675+0000","last_change":"2024-09-17T03:14:36.906986+0000","last_active":"2024-09-17T03:14:40.248675+0000","last_peered":"2024-09-17T03:14:40.248675+0000","last_clean":"2024-09-17T03:14:40.248675+0000","last_became_active":"2024-09-17T03:14:36.906610+0000","last_became_peered":"2024-09-17T03:14:36.906610+0000","last_unstale":"2024-09-17T03:14:40.248675+0000","last_undegraded":"2024-09-17T03:14:40.248675+0000","last_fullsized":"2024-09-17T03:14:40.248675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:06.494486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905169+0000","last_change":"2024-09-17T03:14:37.924573+0000","last_active":"2024-09-17T03:14:39.905169+0000","last_peered":"2024-09-17T03:14:39.905169+0000","last_clean":"2024-09-17T03:14:39.905169+0000","last_became_active":"2024-09-17T03:14:37.917759+0000","last_became_peered":"2024-09-17T03:14:37.917759+0000","last_unstale":"2024-09-17T03:14:39.905169+0000","last_undegraded":"2024-09-17T03:14:39.905169+0000","last_fullsized":"2024-09-17T03:14:39.905169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:28.247627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667188+0000","last_change":"2024-09-17T03:14:36.924180+0000","last_active":"2024-09-17T03:14:39.667188+0000","last_peered":"2024-09-17T03:14:39.667188+0000","last_clean":"2024-09-17T03:14:39.667188+0000","last_became_active":"2024-09-17T03:14:36.923781+0000","last_became_peered":"2024-09-17T03:14:36.923781+0000","last_unstale":"2024-09-17T03:14:39.667188+0000","last_undegraded":"2024-09-17T03:14:39.667188+0000","last_fullsized":"2024-09-17T03:14:39.667188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:44.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917971+0000","last_change":"2024-09-17T03:14:37.931956+0000","last_active":"2024-09-17T03:14:38.917971+0000","last_peered":"2024-09-17T03:14:38.917971+0000","last_clean":"2024-09-17T03:14:38.917971+0000","last_became_active":"2024-09-17T03:14:37.931464+0000","last_became_peered":"2024-09-17T03:14:37.931464+0000","last_unstale":"2024-09-17T03:14:38.917971+0000","last_undegraded":"2024-09-17T03:14:38.917971+0000","last_fullsized":"2024-09-17T03:14:38.917971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:03.949546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.247727+0000","last_change":"2024-09-17T03:14:36.921381+0000","last_active":"2024-09-17T03:14:40.247727+0000","last_peered":"2024-09-17T03:14:40.247727+0000","last_clean":"2024-09-17T03:14:40.247727+0000","last_became_active":"2024-09-17T03:14:36.921084+0000","last_became_peered":"2024-09-17T03:14:36.921084+0000","last_unstale":"2024-09-17T03:14:40.247727+0000","last_undegraded":"2024-09-17T03:14:40.247727+0000","last_fullsized":"2024-09-17T03:14:40.247727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.624911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248557+0000","last_change":"2024-09-17T03:14:37.916083+0000","last_active":"2024-09-17T03:14:40.248557+0000","last_peered":"2024-09-17T03:14:40.248557+0000","last_clean":"2024-09-17T03:14:40.248557+0000","last_became_active":"2024-09-17T03:14:37.912339+0000","last_became_peered":"2024-09-17T03:14:37.912339+0000","last_unstale":"2024-09-17T03:14:40.248557+0000","last_undegraded":"2024-09-17T03:14:40.248557+0000","last_fullsized":"2024-09-17T03:14:40.248557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:39.614597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916628+0000","last_change":"2024-09-17T03:14:36.921428+0000","last_active":"2024-09-17T03:14:38.916628+0000","last_peered":"2024-09-17T03:14:38.916628+0000","last_clean":"2024-09-17T03:14:38.916628+0000","last_became_active":"2024-09-17T03:14:36.921123+0000","last_became_peered":"2024-09-17T03:14:36.921123+0000","last_unstale":"2024-09-17T03:14:38.916628+0000","last_undegraded":"2024-09-17T03:14:38.916628+0000","last_fullsized":"2024-09-17T03:14:38.916628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.979021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916162+0000","last_change":"2024-09-17T03:14:37.909600+0000","last_active":"2024-09-17T03:14:38.916162+0000","last_peered":"2024-09-17T03:14:38.916162+0000","last_clean":"2024-09-17T03:14:38.916162+0000","last_became_active":"2024-09-17T03:14:37.909209+0000","last_became_peered":"2024-09-17T03:14:37.909209+0000","last_unstale":"2024-09-17T03:14:38.916162+0000","last_undegraded":"2024-09-17T03:14:38.916162+0000","last_fullsized":"2024-09-17T03:14:38.916162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:28.685662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667330+0000","last_change":"2024-09-17T03:14:36.923058+0000","last_active":"2024-09-17T03:14:39.667330+0000","last_peered":"2024-09-17T03:14:39.667330+0000","last_clean":"2024-09-17T03:14:39.667330+0000","last_became_active":"2024-09-17T03:14:36.922736+0000","last_became_peered":"2024-09-17T03:14:36.922736+0000","last_unstale":"2024-09-17T03:14:39.667330+0000","last_undegraded":"2024-09-17T03:14:39.667330+0000","last_fullsized":"2024-09-17T03:14:39.667330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:52.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.916722+0000","last_change":"2024-09-17T03:14:37.910283+0000","last_active":"2024-09-17T03:14:38.916722+0000","last_peered":"2024-09-17T03:14:38.916722+0000","last_clean":"2024-09-17T03:14:38.916722+0000","last_became_active":"2024-09-17T03:14:37.909976+0000","last_became_peered":"2024-09-17T03:14:37.909976+0000","last_unstale":"2024-09-17T03:14:38.916722+0000","last_undegraded":"2024-09-17T03:14:38.916722+0000","last_fullsized":"2024-09-17T03:14:38.916722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:59.534040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917812+0000","last_change":"2024-09-17T03:14:36.922118+0000","last_active":"2024-09-17T03:14:38.917812+0000","last_peered":"2024-09-17T03:14:38.917812+0000","last_clean":"2024-09-17T03:14:38.917812+0000","last_became_active":"2024-09-17T03:14:36.921777+0000","last_became_peered":"2024-09-17T03:14:36.921777+0000","last_unstale":"2024-09-17T03:14:38.917812+0000","last_undegraded":"2024-09-17T03:14:38.917812+0000","last_fullsized":"2024-09-17T03:14:38.917812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:58.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888423+0000","last_change":"2024-09-17T03:14:37.911362+0000","last_active":"2024-09-17T03:14:39.888423+0000","last_peered":"2024-09-17T03:14:39.888423+0000","last_clean":"2024-09-17T03:14:39.888423+0000","last_became_active":"2024-09-17T03:14:37.911051+0000","last_became_peered":"2024-09-17T03:14:37.911051+0000","last_unstale":"2024-09-17T03:14:39.888423+0000","last_undegraded":"2024-09-17T03:14:39.888423+0000","last_fullsized":"2024-09-17T03:14:39.888423+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888029+0000","last_change":"2024-09-17T03:14:36.919877+0000","last_active":"2024-09-17T03:14:39.888029+0000","last_peered":"2024-09-17T03:14:39.888029+0000","last_clean":"2024-09-17T03:14:39.888029+0000","last_became_active":"2024-09-17T03:14:36.919462+0000","last_became_peered":"2024-09-17T03:14:36.919462+0000","last_unstale":"2024-09-17T03:14:39.888029+0000","last_undegraded":"2024-09-17T03:14:39.888029+0000","last_fullsized":"2024-09-17T03:14:39.888029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:30.380746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667035+0000","last_change":"2024-09-17T03:14:37.915400+0000","last_active":"2024-09-17T03:14:39.667035+0000","last_peered":"2024-09-17T03:14:39.667035+0000","last_clean":"2024-09-17T03:14:39.667035+0000","last_became_active":"2024-09-17T03:14:37.914731+0000","last_became_peered":"2024-09-17T03:14:37.914731+0000","last_unstale":"2024-09-17T03:14:39.667035+0000","last_undegraded":"2024-09-17T03:14:39.667035+0000","last_fullsized":"2024-09-17T03:14:39.667035+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:12.610229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.887984+0000","last_change":"2024-09-17T03:14:36.917828+0000","last_active":"2024-09-17T03:14:39.887984+0000","last_peered":"2024-09-17T03:14:39.887984+0000","last_clean":"2024-09-17T03:14:39.887984+0000","last_became_active":"2024-09-17T03:14:36.917563+0000","last_became_peered":"2024-09-17T03:14:36.917563+0000","last_unstale":"2024-09-17T03:14:39.887984+0000","last_undegraded":"2024-09-17T03:14:39.887984+0000","last_fullsized":"2024-09-17T03:14:39.887984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917584+0000","last_change":"2024-09-17T03:14:37.912226+0000","last_active":"2024-09-17T03:14:38.917584+0000","last_peered":"2024-09-17T03:14:38.917584+0000","last_clean":"2024-09-17T03:14:38.917584+0000","last_became_active":"2024-09-17T03:14:37.911946+0000","last_became_peered":"2024-09-17T03:14:37.911946+0000","last_unstale":"2024-09-17T03:14:38.917584+0000","last_undegraded":"2024-09-17T03:14:38.917584+0000","last_fullsized":"2024-09-17T03:14:38.917584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:48.422868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248829+0000","last_change":"2024-09-17T03:14:36.911465+0000","last_active":"2024-09-17T03:14:40.248829+0000","last_peered":"2024-09-17T03:14:40.248829+0000","last_clean":"2024-09-17T03:14:40.248829+0000","last_became_active":"2024-09-17T03:14:36.910962+0000","last_became_peered":"2024-09-17T03:14:36.910962+0000","last_unstale":"2024-09-17T03:14:40.248829+0000","last_undegraded":"2024-09-17T03:14:40.248829+0000","last_fullsized":"2024-09-17T03:14:40.248829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.148718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904731+0000","last_change":"2024-09-17T03:14:37.931537+0000","last_active":"2024-09-17T03:14:39.904731+0000","last_peered":"2024-09-17T03:14:39.904731+0000","last_clean":"2024-09-17T03:14:39.904731+0000","last_became_active":"2024-09-17T03:14:37.930870+0000","last_became_peered":"2024-09-17T03:14:37.930870+0000","last_unstale":"2024-09-17T03:14:39.904731+0000","last_undegraded":"2024-09-17T03:14:39.904731+0000","last_fullsized":"2024-09-17T03:14:39.904731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:47.262830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915570+0000","last_change":"2024-09-17T03:14:36.913626+0000","last_active":"2024-09-17T03:14:38.915570+0000","last_peered":"2024-09-17T03:14:38.915570+0000","last_clean":"2024-09-17T03:14:38.915570+0000","last_became_active":"2024-09-17T03:14:36.912768+0000","last_became_peered":"2024-09-17T03:14:36.912768+0000","last_unstale":"2024-09-17T03:14:38.915570+0000","last_undegraded":"2024-09-17T03:14:38.915570+0000","last_fullsized":"2024-09-17T03:14:38.915570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:24.517940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919003+0000","last_change":"2024-09-17T03:14:37.919753+0000","last_active":"2024-09-17T03:14:38.919003+0000","last_peered":"2024-09-17T03:14:38.919003+0000","last_clean":"2024-09-17T03:14:38.919003+0000","last_became_active":"2024-09-17T03:14:37.919458+0000","last_became_peered":"2024-09-17T03:14:37.919458+0000","last_unstale":"2024-09-17T03:14:38.919003+0000","last_undegraded":"2024-09-17T03:14:38.919003+0000","last_fullsized":"2024-09-17T03:14:38.919003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:00.443720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248215+0000","last_change":"2024-09-17T03:14:36.924434+0000","last_active":"2024-09-17T03:14:40.248215+0000","last_peered":"2024-09-17T03:14:40.248215+0000","last_clean":"2024-09-17T03:14:40.248215+0000","last_became_active":"2024-09-17T03:14:36.922875+0000","last_became_peered":"2024-09-17T03:14:36.922875+0000","last_unstale":"2024-09-17T03:14:40.248215+0000","last_undegraded":"2024-09-17T03:14:40.248215+0000","last_fullsized":"2024-09-17T03:14:40.248215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:26.793869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.918123+0000","last_change":"2024-09-17T03:14:37.930593+0000","last_active":"2024-09-17T03:14:38.918123+0000","last_peered":"2024-09-17T03:14:38.918123+0000","last_clean":"2024-09-17T03:14:38.918123+0000","last_became_active":"2024-09-17T03:14:37.930249+0000","last_became_peered":"2024-09-17T03:14:37.930249+0000","last_unstale":"2024-09-17T03:14:38.918123+0000","last_undegraded":"2024-09-17T03:14:38.918123+0000","last_fullsized":"2024-09-17T03:14:38.918123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.975256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667593+0000","last_change":"2024-09-17T03:14:36.915113+0000","last_active":"2024-09-17T03:14:39.667593+0000","last_peered":"2024-09-17T03:14:39.667593+0000","last_clean":"2024-09-17T03:14:39.667593+0000","last_became_active":"2024-09-17T03:14:36.914812+0000","last_became_peered":"2024-09-17T03:14:36.914812+0000","last_unstale":"2024-09-17T03:14:39.667593+0000","last_undegraded":"2024-09-17T03:14:39.667593+0000","last_fullsized":"2024-09-17T03:14:39.667593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.229040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905311+0000","last_change":"2024-09-17T03:14:37.931554+0000","last_active":"2024-09-17T03:14:39.905311+0000","last_peered":"2024-09-17T03:14:39.905311+0000","last_clean":"2024-09-17T03:14:39.905311+0000","last_became_active":"2024-09-17T03:14:37.930825+0000","last_became_peered":"2024-09-17T03:14:37.930825+0000","last_unstale":"2024-09-17T03:14:39.905311+0000","last_undegraded":"2024-09-17T03:14:39.905311+0000","last_fullsized":"2024-09-17T03:14:39.905311+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:06.238924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917956+0000","last_change":"2024-09-17T03:14:36.922204+0000","last_active":"2024-09-17T03:14:38.917956+0000","last_peered":"2024-09-17T03:14:38.917956+0000","last_clean":"2024-09-17T03:14:38.917956+0000","last_became_active":"2024-09-17T03:14:36.921846+0000","last_became_peered":"2024-09-17T03:14:36.921846+0000","last_unstale":"2024-09-17T03:14:38.917956+0000","last_undegraded":"2024-09-17T03:14:38.917956+0000","last_fullsized":"2024-09-17T03:14:38.917956+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:35.900648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.888313+0000","last_change":"2024-09-17T03:14:37.924380+0000","last_active":"2024-09-17T03:14:39.888313+0000","last_peered":"2024-09-17T03:14:39.888313+0000","last_clean":"2024-09-17T03:14:39.888313+0000","last_became_active":"2024-09-17T03:14:37.924111+0000","last_became_peered":"2024-09-17T03:14:37.924111+0000","last_unstale":"2024-09-17T03:14:39.888313+0000","last_undegraded":"2024-09-17T03:14:39.888313+0000","last_fullsized":"2024-09-17T03:14:39.888313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:26.021459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917939+0000","last_change":"2024-09-17T03:14:36.921890+0000","last_active":"2024-09-17T03:14:38.917939+0000","last_peered":"2024-09-17T03:14:38.917939+0000","last_clean":"2024-09-17T03:14:38.917939+0000","last_became_active":"2024-09-17T03:14:36.921468+0000","last_became_peered":"2024-09-17T03:14:36.921468+0000","last_unstale":"2024-09-17T03:14:38.917939+0000","last_undegraded":"2024-09-17T03:14:38.917939+0000","last_fullsized":"2024-09-17T03:14:38.917939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.917497+0000","last_change":"2024-09-17T03:14:37.938088+0000","last_active":"2024-09-17T03:14:38.917497+0000","last_peered":"2024-09-17T03:14:38.917497+0000","last_clean":"2024-09-17T03:14:38.917497+0000","last_became_active":"2024-09-17T03:14:37.937723+0000","last_became_peered":"2024-09-17T03:14:37.937723+0000","last_unstale":"2024-09-17T03:14:38.917497+0000","last_undegraded":"2024-09-17T03:14:38.917497+0000","last_fullsized":"2024-09-17T03:14:38.917497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:35.741738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919097+0000","last_change":"2024-09-17T03:14:36.917011+0000","last_active":"2024-09-17T03:14:38.919097+0000","last_peered":"2024-09-17T03:14:38.919097+0000","last_clean":"2024-09-17T03:14:38.919097+0000","last_became_active":"2024-09-17T03:14:36.916298+0000","last_became_peered":"2024-09-17T03:14:36.916298+0000","last_unstale":"2024-09-17T03:14:38.919097+0000","last_undegraded":"2024-09-17T03:14:38.919097+0000","last_fullsized":"2024-09-17T03:14:38.919097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:26.488733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.248462+0000","last_change":"2024-09-17T03:14:37.928215+0000","last_active":"2024-09-17T03:14:40.248462+0000","last_peered":"2024-09-17T03:14:40.248462+0000","last_clean":"2024-09-17T03:14:40.248462+0000","last_became_active":"2024-09-17T03:14:37.927665+0000","last_became_peered":"2024-09-17T03:14:37.927665+0000","last_unstale":"2024-09-17T03:14:40.248462+0000","last_undegraded":"2024-09-17T03:14:40.248462+0000","last_fullsized":"2024-09-17T03:14:40.248462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:20.020588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904813+0000","last_change":"2024-09-17T03:14:36.922835+0000","last_active":"2024-09-17T03:14:39.904813+0000","last_peered":"2024-09-17T03:14:39.904813+0000","last_clean":"2024-09-17T03:14:39.904813+0000","last_became_active":"2024-09-17T03:14:36.922217+0000","last_became_peered":"2024-09-17T03:14:36.922217+0000","last_unstale":"2024-09-17T03:14:39.904813+0000","last_undegraded":"2024-09-17T03:14:39.904813+0000","last_fullsized":"2024-09-17T03:14:39.904813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:59.651903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667640+0000","last_change":"2024-09-17T03:14:37.916054+0000","last_active":"2024-09-17T03:14:39.667640+0000","last_peered":"2024-09-17T03:14:39.667640+0000","last_clean":"2024-09-17T03:14:39.667640+0000","last_became_active":"2024-09-17T03:14:37.915360+0000","last_became_peered":"2024-09-17T03:14:37.915360+0000","last_unstale":"2024-09-17T03:14:39.667640+0000","last_undegraded":"2024-09-17T03:14:39.667640+0000","last_fullsized":"2024-09-17T03:14:39.667640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:12.876720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667264+0000","last_change":"2024-09-17T03:14:36.915925+0000","last_active":"2024-09-17T03:14:39.667264+0000","last_peered":"2024-09-17T03:14:39.667264+0000","last_clean":"2024-09-17T03:14:39.667264+0000","last_became_active":"2024-09-17T03:14:36.914802+0000","last_became_peered":"2024-09-17T03:14:36.914802+0000","last_unstale":"2024-09-17T03:14:39.667264+0000","last_undegraded":"2024-09-17T03:14:39.667264+0000","last_fullsized":"2024-09-17T03:14:39.667264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:55.918240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.905091+0000","last_change":"2024-09-17T03:14:37.916882+0000","last_active":"2024-09-17T03:14:39.905091+0000","last_peered":"2024-09-17T03:14:39.905091+0000","last_clean":"2024-09-17T03:14:39.905091+0000","last_became_active":"2024-09-17T03:14:37.916570+0000","last_became_peered":"2024-09-17T03:14:37.916570+0000","last_unstale":"2024-09-17T03:14:39.905091+0000","last_undegraded":"2024-09-17T03:14:39.905091+0000","last_fullsized":"2024-09-17T03:14:39.905091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.964184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.919520+0000","last_change":"2024-09-17T03:14:36.918082+0000","last_active":"2024-09-17T03:14:38.919520+0000","last_peered":"2024-09-17T03:14:38.919520+0000","last_clean":"2024-09-17T03:14:38.919520+0000","last_became_active":"2024-09-17T03:14:36.917391+0000","last_became_peered":"2024-09-17T03:14:36.917391+0000","last_unstale":"2024-09-17T03:14:38.919520+0000","last_undegraded":"2024-09-17T03:14:38.919520+0000","last_fullsized":"2024-09-17T03:14:38.919520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.529033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.667521+0000","last_change":"2024-09-17T03:14:37.937637+0000","last_active":"2024-09-17T03:14:39.667521+0000","last_peered":"2024-09-17T03:14:39.667521+0000","last_clean":"2024-09-17T03:14:39.667521+0000","last_became_active":"2024-09-17T03:14:37.937349+0000","last_became_peered":"2024-09-17T03:14:37.937349+0000","last_unstale":"2024-09-17T03:14:39.667521+0000","last_undegraded":"2024-09-17T03:14:39.667521+0000","last_fullsized":"2024-09-17T03:14:39.667521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:36.883541+0000","last_clean_scrub_stamp":"2024-09-17T03:14:36.883541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:49.312689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.904741+0000","last_change":"2024-09-17T03:14:36.919006+0000","last_active":"2024-09-17T03:14:39.904741+0000","last_peered":"2024-09-17T03:14:39.904741+0000","last_clean":"2024-09-17T03:14:39.904741+0000","last_became_active":"2024-09-17T03:14:36.916543+0000","last_became_peered":"2024-09-17T03:14:36.916543+0000","last_unstale":"2024-09-17T03:14:39.904741+0000","last_undegraded":"2024-09-17T03:14:39.904741+0000","last_fullsized":"2024-09-17T03:14:39.904741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:35.873656+0000","last_clean_scrub_stamp":"2024-09-17T03:14:35.873656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:46.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":144,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T03:14:38.915414+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:14:38.915414+0000","last_peered":"2024-09-17T03:14:38.915414+0000","last_clean":"2024-09-17T03:14:38.915414+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:14:38.915414+0000","last_undegraded":"2024-09-17T03:14:38.915414+0000","last_fullsized":"2024-09-17T03:14:38.915414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":202451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":200805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":791105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":200807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":200749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:47.806 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:14:47.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:14:48.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 -- 172.21.15.153:0/3905158852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7200d12e0 msgr2=0x7fb7200d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 --2- 172.21.15.153:0/3905158852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7200d12e0 0x7fb7200d16f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb720074a40 tx=0x7fb70802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 -- 172.21.15.153:0/3905158852 shutdown_connections 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 --2- 172.21.15.153:0/3905158852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7200d12e0 0x7fb7200d16f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 --2- 172.21.15.153:0/3905158852 >> v2:172.21.15.164:3300/0 conn(0x7fb72015cb10 0x7fb72015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 -- 172.21.15.153:0/3905158852 >> 172.21.15.153:0/3905158852 conn(0x7fb7200d2350 msgr2=0x7fb7200d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 -- 172.21.15.153:0/3905158852 shutdown_connections 2024-09-17T03:14:48.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.073+0000 7fb726000640 1 -- 172.21.15.153:0/3905158852 wait complete. 2024-09-17T03:14:48.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.075+0000 7fb726000640 1 Processor -- start 2024-09-17T03:14:48.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.075+0000 7fb726000640 1 -- start start 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 0x7fb720151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb720160100 0x7fb7201f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200b73e0 con 0x7fb72015cb10 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200b7260 con 0x7fb720160100 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb726000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb720160c20 con 0x7fb7200d12e0 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb716a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb716a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48374/0 (socket says 172.21.15.153:48374) 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb716a00640 1 -- 172.21.15.153:0/593967215 learned_addr learned my addr 172.21.15.153:0/593967215 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb71f400640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 0x7fb720151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.077+0000 7fb71fe00640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb720160100 0x7fb7201f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 -- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 msgr2=0x7fb720151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 0x7fb720151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 -- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb720160100 msgr2=0x7fb7201f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb720160100 0x7fb7201f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 -- 172.21.15.153:0/593967215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7201f6ce0 con 0x7fb72015cb10 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb71f400640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 0x7fb720151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.078+0000 7fb716a00640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb708003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.079+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70803e030 con 0x7fb72015cb10 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.079+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb708003d10 con 0x7fb72015cb10 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.079+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7201f6fc0 con 0x7fb72015cb10 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.079+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708035040 con 0x7fb72015cb10 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.079+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7201f7580 con 0x7fb72015cb10 2024-09-17T03:14:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.080+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7200d16f0 con 0x7fb72015cb10 2024-09-17T03:14:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.081+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb708041030 con 0x7fb72015cb10 2024-09-17T03:14:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.082+0000 7fb717e00640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 0x7fb6fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.082+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb7080bb550 con 0x7fb72015cb10 2024-09-17T03:14:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.082+0000 7fb71f400640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 0x7fb6fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.083+0000 7fb71f400640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 0x7fb6fc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb710009f20 tx=0x7fb710005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.086+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7080831a0 con 0x7fb72015cb10 2024-09-17T03:14:48.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.338+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb72015cfc0 con 0x7fb72015cb10 2024-09-17T03:14:48.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.341+0000 7fb717e00640 1 -- 172.21.15.153:0/593967215 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fb708087bd0 con 0x7fb72015cb10 2024-09-17T03:14:48.340 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-17T03:14:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ== 2024-09-17T03:14:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2024-09-17T03:14:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2024-09-17T03:14:48.341 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:14:48.341 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2024-09-17T03:14:48.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 msgr2=0x7fb6fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 0x7fb6fc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb710009f20 tx=0x7fb710005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 msgr2=0x7fb7201f7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb708003820 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 shutdown_connections 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb6fc078b90 0x7fb6fc07b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb720160100 0x7fb7201f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb72015cb10 0x7fb7201f7d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 --2- 172.21.15.153:0/593967215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7200d12e0 0x7fb720151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 >> 172.21.15.153:0/593967215 conn(0x7fb7200d2350 msgr2=0x7fb720154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 shutdown_connections 2024-09-17T03:14:48.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.344+0000 7fb726000640 1 -- 172.21.15.153:0/593967215 wait complete. 2024-09-17T03:14:48.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:48.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 -- 172.21.15.153:0/3757537090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 msgr2=0x7f6c9815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 --2- 172.21.15.153:0/3757537090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c9815f5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c90005fd0 tx=0x7f6c9002aa00 comp rx=0 tx=0).stop 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 -- 172.21.15.153:0/3757537090 shutdown_connections 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 --2- 172.21.15.153:0/3757537090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c9815f5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 --2- 172.21.15.153:0/3757537090 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c980cf930 0x7f6c980ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 -- 172.21.15.153:0/3757537090 >> 172.21.15.153:0/3757537090 conn(0x7f6c980cca40 msgr2=0x7f6c980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 -- 172.21.15.153:0/3757537090 shutdown_connections 2024-09-17T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.592+0000 7f6ca0600640 1 -- 172.21.15.153:0/3757537090 wait complete. 2024-09-17T03:14:48.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.594+0000 7f6ca0600640 1 Processor -- start 2024-09-17T03:14:48.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.595+0000 7f6ca0600640 1 -- start start 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c980cf930 0x7f6c981f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c9815b9f0 0x7f6c981f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9806df70 con 0x7f6c980ce860 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9806ddf0 con 0x7f6c980cf930 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6ca0600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9806e0f0 con 0x7f6c9815b9f0 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6c9dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6c9dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48396/0 (socket says 172.21.15.153:48396) 2024-09-17T03:14:48.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6c9dc00640 1 -- 172.21.15.153:0/2609531369 learned_addr learned my addr 172.21.15.153:0/2609531369 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6c9d200640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c980cf930 0x7f6c981f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.596+0000 7f6c9e600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c9815b9f0 0x7f6c981f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 -- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c9815b9f0 msgr2=0x7f6c981f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c9815b9f0 0x7f6c981f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 -- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c980cf930 msgr2=0x7f6c981f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c980cf930 0x7f6c981f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 -- 172.21.15.153:0/2609531369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c98157400 con 0x7f6c980ce860 2024-09-17T03:14:48.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c9dc00640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3f0 tx=0x7f6c8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c015020 con 0x7f6c980ce860 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c8c011920 con 0x7f6c980ce860 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c011d70 con 0x7f6c980ce860 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c980c6690 con 0x7f6c980ce860 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.597+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c980c6c50 con 0x7f6c980ce860 2024-09-17T03:14:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.598+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c980cb570 con 0x7f6c980ce860 2024-09-17T03:14:48.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.600+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c8c018020 con 0x7f6c980ce860 2024-09-17T03:14:48.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.600+0000 7f6c95600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:48.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.601+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f6c8c09a9c0 con 0x7f6c980ce860 2024-09-17T03:14:48.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.601+0000 7f6c9d200640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:48.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.602+0000 7f6c9d200640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c98152820 tx=0x7f6c8400b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:48.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.605+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c980cb570 con 0x7f6c980ce860 2024-09-17T03:14:48.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.823+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c980c6e20 con 0x7f6c980ce860 2024-09-17T03:14:48.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.824+0000 7f6c95600640 1 -- 172.21.15.153:0/2609531369 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f6c980c6e20 con 0x7f6c980ce860 2024-09-17T03:14:48.823 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"btime":"2024-09-17T03:14:40:924795+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3190390573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3190390573},{"type":"v1","addr":"172.21.15.164:6836","nonce":3190390573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4939,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1750845241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1750845241},{"type":"v1","addr":"172.21.15.164:6837","nonce":1750845241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3449978034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3449978034},{"type":"v1","addr":"172.21.15.153:6834","nonce":3449978034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:40.410947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5004":{"gid":5004,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/402446814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":402446814},{"type":"v1","addr":"172.21.15.153:6835","nonce":402446814}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5004,"qdb_cluster":[5004]},"id":2}]} 2024-09-17T03:14:48.823 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-09-17T03:14:48.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 msgr2=0x7f6c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c98152820 tx=0x7f6c8400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 msgr2=0x7f6c980c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3f0 tx=0x7f6c8c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 shutdown_connections 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6c9815b9f0 0x7f6c981f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c980cf930 0x7f6c981f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 --2- 172.21.15.153:0/2609531369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c980ce860 0x7f6c980c5a80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 >> 172.21.15.153:0/2609531369 conn(0x7f6c980cca40 msgr2=0x7f6c98073f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 shutdown_connections 2024-09-17T03:14:48.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:48.826+0000 7f6ca0600640 1 -- 172.21.15.153:0/2609531369 wait complete. 2024-09-17T03:14:49.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:37.396372+0000', 'modified': '2024-09-17T03:14:40.410947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5004}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5004': {'gid': 5004, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/402446814', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 402446814}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 402446814}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5004, 'qdb_cluster': [5004]} 2024-09-17T03:14:49.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:14:49.251 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 -- 172.21.15.153:0/2861738644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f314c003a70 msgr2=0x7f314c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 --2- 172.21.15.153:0/2861738644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f314c003a70 0x7f314c003ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3158006f70 tx=0x7f314c005830 comp rx=0 tx=0).stop 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 -- 172.21.15.153:0/2861738644 shutdown_connections 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 --2- 172.21.15.153:0/2861738644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f314c003a70 0x7f314c003ea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 -- 172.21.15.153:0/2861738644 >> 172.21.15.153:0/2861738644 conn(0x7f31680d05c0 msgr2=0x7f316806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.477+0000 7f316ca00640 1 -- 172.21.15.153:0/2861738644 shutdown_connections 2024-09-17T03:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.478+0000 7f316ca00640 1 -- 172.21.15.153:0/2861738644 wait complete. 2024-09-17T03:14:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.480+0000 7f316ca00640 1 Processor -- start 2024-09-17T03:14:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.480+0000 7f316ca00640 1 -- start start 2024-09-17T03:14:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f314c003a70 0x7f3168156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 0x7f31681efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f316815fee0 con 0x7f31681f3080 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3168070780 con 0x7f314c003a70 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.481+0000 7f316ca00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3168160060 con 0x7f3168141780 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48414/0 (socket says 172.21.15.153:48414) 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 -- 172.21.15.153:0/1345155517 learned_addr learned my addr 172.21.15.153:0/1345155517 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167400640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f314c003a70 0x7f3168156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f315ea00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 0x7f31681efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 -- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 msgr2=0x7f31681efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 0x7f31681efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 -- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f314c003a70 msgr2=0x7f3168156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f314c003a70 0x7f3168156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 -- 172.21.15.153:0/1345155517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31681f6640 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f315ea00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 0x7f31681efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f3167e00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3160000f80 tx=0x7f31600064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.482+0000 7f315fe00640 1 -- 172.21.15.153:0/1345155517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160011900 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.483+0000 7f315fe00640 1 -- 172.21.15.153:0/1345155517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3160018070 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.483+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31681f6920 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.483+0000 7f315fe00640 1 -- 172.21.15.153:0/1345155517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160011d40 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.483+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31681f2b60 con 0x7f31681f3080 2024-09-17T03:14:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.485+0000 7f315fe00640 1 -- 172.21.15.153:0/1345155517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f316001d460 con 0x7f31681f3080 2024-09-17T03:14:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.486+0000 7f315fe00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 0x7f314407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.486+0000 7f315fe00640 1 -- 172.21.15.153:0/1345155517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f316009b860 con 0x7f31681f3080 2024-09-17T03:14:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.486+0000 7f3167400640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 0x7f314407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.487+0000 7f317502e740 1 Processor -- start 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.487+0000 7f317502e740 1 -- start start 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.487+0000 7f3167400640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 0x7f314407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3158033000 tx=0x7f31680cde00 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c243b0 0x556461fee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x556461fee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556461f77430 con 0x556461c4d270 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x556461f675d0 con 0x556461c243b0 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x556461f56a00 con 0x556461c2c590 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f3167400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f3167400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48422/0 (socket says 172.21.15.153:48422) 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f3167400640 1 -- 172.21.15.153:0/2489793279 learned_addr learned my addr 172.21.15.153:0/2489793279 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.488+0000 7f3167e00640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x556461fee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f315ea00640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c243b0 0x556461fee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 -- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 msgr2=0x556461fee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x556461fee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 -- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c243b0 msgr2=0x556461fee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c243b0 0x556461fee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 -- 172.21.15.153:0/2489793279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556461f1f520 con 0x556461c4d270 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167e00640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x556461fee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3167400640 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3158031040 tx=0x7f315803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5ab4a026a820b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.489+0000 7f3157400640 1 -- 172.21.15.153:0/2489793279 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158032070 con 0x556461c4d270 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f3157400640 1 -- 172.21.15.153:0/2489793279 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31580064e0 con 0x556461c4d270 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f3157400640 1 -- 172.21.15.153:0/2489793279 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158003ac0 con 0x556461c4d270 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 -- 172.21.15.153:0/2489793279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 msgr2=0x556462038c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3158031040 tx=0x7f315803d000 comp rx=0 tx=0).stop 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 -- 172.21.15.153:0/2489793279 shutdown_connections 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x556461fee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c243b0 0x556461fee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 --2- 172.21.15.153:0/2489793279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x556462038c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.490+0000 7f317502e740 1 -- 172.21.15.153:0/2489793279 >> 172.21.15.153:0/2489793279 conn(0x556461c413c0 msgr2=0x556461ff3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.491+0000 7f317502e740 1 -- 172.21.15.153:0/2489793279 shutdown_connections 2024-09-17T03:14:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.491+0000 7f317502e740 1 -- 172.21.15.153:0/2489793279 wait complete. 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.492+0000 7f317502e740 1 -- start start 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.492+0000 7f317502e740 1 Processor -- start 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462031c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c2c590 0x556462015030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556461efd330 con 0x556461c4d270 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x556461f5a810 con 0x556461c2c590 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x556461cc7620 con 0x556461c243b0 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.493+0000 7f317502e740 10 client.0 _ll_register_callbacks cb 0x556461f02420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48434/0 (socket says 172.21.15.153:48434) 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 -- 172.21.15.153:0/3100415406 learned_addr learned my addr 172.21.15.153:0/3100415406 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167400640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462031c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f315ea00640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c2c590 0x556462015030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 -- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 msgr2=0x556462031c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462031c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 -- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c2c590 msgr2=0x556462015030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c2c590 0x556462015030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 -- 172.21.15.153:0/3100415406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556461cb8850 con 0x556461c4d270 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f3167e00640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f316005f380 tx=0x7f3160063990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4364103faf3e7c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f314be00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.494+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160063a70 con 0x556461c4d270 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f316005ecc0 con 0x556461c4d270 2024-09-17T03:14:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31580064e0 con 0x556461c4d270 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3160063370 con 0x556461c4d270 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 10 client.5169 fetch_fsmap learned FSMap version 18 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556461d2f6b0 con 0x556461c4d270 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31580064e0 con 0x556461c4d270 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f316005eec0 con 0x556461c4d270 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 10 client.5169 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 10 client.5169 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 20 client.5169 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x556461c0be40 0x55646202fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 4 client.5169 mds_command: new command op to 5004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 --> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556461f69520 con 0x556461c0be40 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.495+0000 7f3167400640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x556461c0be40 0x55646202fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.496+0000 7f3167400640 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x556461c0be40 0x55646202fa90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f47b5a07cd1d6d server_cookie=3d78c8a81398fc90 in_seq=0 out_seq=0 2024-09-17T03:14:49.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.496+0000 7f314be00640 10 client.5169 ms_handle_connect on v2:172.21.15.153:6833/402446814 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f314be00640 1 -- 172.21.15.153:0/3100415406 <== mds.0 v2:172.21.15.153:6833/402446814 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556461f69520 con 0x556461c0be40 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f314be00640 10 client.5169 handle_command_reply: tid=0 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 client.5169 shutdown 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 msgr2=0x55646204bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f316005f380 tx=0x7f3160063990 comp rx=0 tx=0).stop 2024-09-17T03:14:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 shutdown_connections 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c4d270 0x55646204bda0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c2c590 0x556462015030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x556461c0be40 0x55646202fa90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 --2- 172.21.15.153:0/3100415406 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462031c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 >> 172.21.15.153:0/3100415406 conn(0x556461c413c0 msgr2=0x55646201a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f314be00640 0 client.5169 ms_handle_reset on v2:172.21.15.153:6833/402446814 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 shutdown_connections 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.497+0000 7f317502e740 1 -- 172.21.15.153:0/3100415406 wait complete. 2024-09-17T03:14:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.498+0000 7f317502e740 20 client.5169 trim_cache size 0 max 16384 2024-09-17T03:14:49.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.516+0000 7f317502e740 1 Processor -- start 2024-09-17T03:14:49.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.517+0000 7f317502e740 1 -- start start 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462035ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x55646205fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31681fd110 con 0x556461c2c590 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3168074120 con 0x556461c4d270 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3168074770 con 0x556461c243b0 2024-09-17T03:14:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f315ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f315ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48446/0 (socket says 172.21.15.153:48446) 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f315ea00640 1 -- 172.21.15.153:0/485347841 learned_addr learned my addr 172.21.15.153:0/485347841 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f3167e00640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x55646205fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.518+0000 7f3167400640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462035ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 -- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 msgr2=0x556462035ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462035ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 -- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 msgr2=0x55646205fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x55646205fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 -- 172.21.15.153:0/485347841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556461ff2df0 con 0x556461c2c590 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f3167400640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462035ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f315ea00640 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3150009c50 tx=0x7f3150011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ff41a42260835f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f3156a00640 1 -- 172.21.15.153:0/485347841 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150004020 con 0x556461c2c590 2024-09-17T03:14:49.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f3156a00640 1 -- 172.21.15.153:0/485347841 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31500041c0 con 0x556461c2c590 2024-09-17T03:14:49.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.519+0000 7f3156a00640 1 -- 172.21.15.153:0/485347841 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31500035f0 con 0x556461c2c590 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 -- 172.21.15.153:0/485347841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 msgr2=0x55646205f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3150009c50 tx=0x7f3150011810 comp rx=0 tx=0).stop 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 -- 172.21.15.153:0/485347841 shutdown_connections 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x55646205fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c2c590 0x55646205f8d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 --2- 172.21.15.153:0/485347841 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c243b0 0x556462035ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 -- 172.21.15.153:0/485347841 >> 172.21.15.153:0/485347841 conn(0x556461c413c0 msgr2=0x556461ff2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 -- 172.21.15.153:0/485347841 shutdown_connections 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.520+0000 7f317502e740 1 -- 172.21.15.153:0/485347841 wait complete. 2024-09-17T03:14:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.521+0000 7f317502e740 1 -- start start 2024-09-17T03:14:49.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.521+0000 7f317502e740 1 Processor -- start 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x55646203b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x5564620bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55646203cb50 con 0x556461c243b0 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55646204c4b0 con 0x556461c4d270 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55646203a0b0 con 0x556461c2c590 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f317502e740 10 client.0 _ll_register_callbacks cb 0x7f3160062ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48454/0 (socket says 172.21.15.153:48454) 2024-09-17T03:14:49.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 -- 172.21.15.153:0/567489983 learned_addr learned my addr 172.21.15.153:0/567489983 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167e00640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x5564620bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f315ea00640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x55646203b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 -- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 msgr2=0x55646203b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x55646203b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 -- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 msgr2=0x5564620bfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x5564620bfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.523+0000 7f3167400640 1 -- 172.21.15.153:0/567489983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564620bc7f0 con 0x556461c243b0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f3167400640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f315800c350 tx=0x7f31680cc990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e49227ecde1330 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f314be00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580064e0 con 0x556461c243b0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f315803e040 con 0x556461c243b0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31500041c0 con 0x556461c243b0 2024-09-17T03:14:49.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3158061050 con 0x556461c243b0 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f317502e740 10 client.5175 fetch_fsmap learned FSMap version 18 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.524+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556462036250 con 0x556461c243b0 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31500041c0 con 0x556461c243b0 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f3158064020 con 0x556461c243b0 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 10 client.5175 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 10 client.5175 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 20 client.5175 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x5564620c0650 0x55646202f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 4 client.5175 mds_command: new command op to 5004 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 --> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] -- command(tid 0: {"prefix": "status"}) -- 0x556461f64fd0 con 0x5564620c0650 2024-09-17T03:14:49.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.525+0000 7f315ea00640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x5564620c0650 0x55646202f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f315ea00640 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x5564620c0650 0x55646202f980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1140227ccedfec server_cookie=b1d145d8fd3eff50 in_seq=0 out_seq=0 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f314be00640 10 client.5175 ms_handle_connect on v2:172.21.15.153:6833/402446814 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f314be00640 1 -- 172.21.15.153:0/567489983 <== mds.0 v2:172.21.15.153:6833/402446814 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556461f64fd0 con 0x5564620c0650 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f314be00640 10 client.5175 handle_command_reply: tid=0 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 client.5175 shutdown 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 msgr2=0x55646203b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f315800c350 tx=0x7f31680cc990 comp rx=0 tx=0).stop 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 shutdown_connections 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556461c4d270 0x5564620bfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:6833/402446814,v1:172.21.15.153:6835/402446814] conn(0x5564620c0650 0x55646202f980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x556461c2c590 0x55646203b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 --2- 172.21.15.153:0/567489983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556461c243b0 0x55646203b0f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f314be00640 0 client.5175 ms_handle_reset on v2:172.21.15.153:6833/402446814 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 >> 172.21.15.153:0/567489983 conn(0x556461c413c0 msgr2=0x556462014cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 shutdown_connections 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 1 -- 172.21.15.153:0/567489983 wait complete. 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.526+0000 7f317502e740 20 client.5175 trim_cache size 0 max 16384 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:14:49.529 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5004, 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 11.632274775000001, 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 18, 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 41, 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 41, 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 19.357317006999999 2024-09-17T03:14:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:14:49.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 msgr2=0x7f314407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 0x7f314407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3158033000 tx=0x7f31680cde00 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 msgr2=0x7f31681f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3160000f80 tx=0x7f31600064f0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 shutdown_connections 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3144078b90 0x7f314407b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31681f3080 0x7f31681f3490 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3168141780 0x7f31681efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 --2- 172.21.15.153:0/1345155517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f314c003a70 0x7f3168156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 >> 172.21.15.153:0/1345155517 conn(0x7f31680d05c0 msgr2=0x7f31681456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 shutdown_connections 2024-09-17T03:14:49.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.527+0000 7f316ca00640 1 -- 172.21.15.153:0/1345155517 wait complete. 2024-09-17T03:14:49.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:49.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 -- 172.21.15.153:0/1807574330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43840cb750 msgr2=0x7f43840af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 --2- 172.21.15.153:0/1807574330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43840cb750 0x7f43840af420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4378009830 tx=0x7f437802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 -- 172.21.15.153:0/1807574330 shutdown_connections 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 --2- 172.21.15.153:0/1807574330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43840cb750 0x7f43840af420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 -- 172.21.15.153:0/1807574330 >> 172.21.15.153:0/1807574330 conn(0x7f43840cca40 msgr2=0x7f43840cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 -- 172.21.15.153:0/1807574330 shutdown_connections 2024-09-17T03:14:49.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.768+0000 7f438be00640 1 -- 172.21.15.153:0/1807574330 wait complete. 2024-09-17T03:14:49.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.770+0000 7f438be00640 1 Processor -- start 2024-09-17T03:14:49.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.771+0000 7f438be00640 1 -- start start 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.772+0000 7f438be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f438be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 0x7f438415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f438be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 0x7f438415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f438be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43840ce8a0 con 0x7f438415e7c0 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f438be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f43840ce720 con 0x7f438415d5e0 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f438be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f43840cea20 con 0x7f438415c400 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48476/0 (socket says 172.21.15.153:48476) 2024-09-17T03:14:49.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 -- 172.21.15.153:0/2551752021 learned_addr learned my addr 172.21.15.153:0/2551752021 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4388a00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 0x7f438415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389e00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 0x7f438415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 -- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 msgr2=0x7f438415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 0x7f438415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 -- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 msgr2=0x7f438415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 0x7f438415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389400640 1 -- 172.21.15.153:0/2551752021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438415df30 con 0x7f438415e7c0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4389e00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 0x7f438415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.773+0000 7f4388a00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 0x7f438415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f4389400640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4378009950 tx=0x7f4378033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378031d60 con 0x7f438415e7c0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43780330d0 con 0x7f438415e7c0 2024-09-17T03:14:49.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43840b3e60 con 0x7f438415e7c0 2024-09-17T03:14:49.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378033520 con 0x7f438415e7c0 2024-09-17T03:14:49.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.774+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43840b4420 con 0x7f438415e7c0 2024-09-17T03:14:49.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.775+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43840cb750 con 0x7f438415e7c0 2024-09-17T03:14:49.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.776+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43780035f0 con 0x7f438415e7c0 2024-09-17T03:14:49.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.777+0000 7f4381600640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 0x7f436407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.777+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f43780bc4e0 con 0x7f438415e7c0 2024-09-17T03:14:49.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.778+0000 7f4388a00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 0x7f436407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.778+0000 7f4388a00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 0x7f436407b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4384160270 tx=0x7f4370009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:49.782+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f438415df30 con 0x7f438415e7c0 2024-09-17T03:14:50.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.000+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43840b5f40 con 0x7f438415e7c0 2024-09-17T03:14:50.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.001+0000 7f4381600640 1 -- 172.21.15.153:0/2551752021 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f437803f030 con 0x7f438415e7c0 2024-09-17T03:14:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:14:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 msgr2=0x7f436407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 0x7f436407b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4384160270 tx=0x7f4370009040 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 msgr2=0x7f4384159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4378009950 tx=0x7f4378033d60 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 shutdown_connections 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4364078b90 0x7f436407b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f438415d5e0 0x7f438415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f438415c400 0x7f438415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 --2- 172.21.15.153:0/2551752021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f438415e7c0 0x7f4384159770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 >> 172.21.15.153:0/2551752021 conn(0x7f43840cca40 msgr2=0x7f43840a0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 shutdown_connections 2024-09-17T03:14:50.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50.003+0000 7f438be00640 1 -- 172.21.15.153:0/2551752021 wait complete. 2024-09-17T03:14:50.025 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:14:50.025 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:50.025 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-17T03:14:50.025 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:14:50.025 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:50.026 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:14:50.026 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:14:50.026 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:50.026 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:50.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.026 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:50.063 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::48ca:57ff:fe1c:b853/64 scope link 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:14:50.064 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::30bd:f5ff:fe93:c568/64 scope link 2024-09-17T03:14:50.065 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:50.065 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 96:f0:31:4d:ee:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:14:50.065 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::94f0:31ff:fe4d:ee13/64 scope link 2024-09-17T03:14:50.065 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:50.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.066 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-17T03:14:50.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.162 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-17T03:14:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-17T03:14:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:50.199 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:50.199 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:14:50.199 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:50.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:50.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:50.200 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:14:50.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:50.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.397 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:14:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:14:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:14:50.433 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:50.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.433 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-17T03:14:50.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:50.529 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:50.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:50.565 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:50.640 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:50.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:14:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:14:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:14:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:14:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:14:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:14:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:50.891 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:50.894 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:50.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:50.894 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:50.953 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:51.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:client5187 2024-09-17T03:14:51.050 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:51.050 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:51.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:14:51.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.238 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.239 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:14:51.240 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T03:14:51.241 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:14:51.243 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:14:51.244 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.245 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:14:51.246 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T03:14:51.247 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2024-09-17T03:14:51.248 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi164.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-09-17T03:14:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T03:14:51.250 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T03:14:51.251 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.252 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.253 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.254 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:14:51.255 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T03:14:51.256 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:14:51.257 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T03:14:51.258 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-17T03:14:51.259 INFO:teuthology.orchestra.run.smithi153.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-09-17T03:14:51.265 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:14:51.265 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:14:51.265 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:14:51.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:51.266 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:14:51.266 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:14:51.266 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:14:51.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:51.266 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:14:51.267 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:14:51.267 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:14:51.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:51.267 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:14:51.267 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:14:51.267 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:14:51.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:51.288 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:14:51.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:14:51.289 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:14:51.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:14:51.290 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:14:51.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:14:51.294 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:14:51.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:14:51.335 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:14:51.335 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:51.337 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:14:51.337 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:51.338 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:14:51.339 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:51.340 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:14:51.340 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:51.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:51.530 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:14:51.530 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:14:51.540 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-09-17T03:14:51.554 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:14:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 -- 172.21.15.153:0/3803980185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202806fcb0 msgr2=0x7f202815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 --2- 172.21.15.153:0/3803980185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202806fcb0 0x7f202815f2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f202815fd90 tx=0x7f201402a540 comp rx=0 tx=0).stop 2024-09-17T03:14:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 -- 172.21.15.153:0/3803980185 shutdown_connections 2024-09-17T03:14:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 --2- 172.21.15.153:0/3803980185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202806fcb0 0x7f202815f2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 --2- 172.21.15.153:0/3803980185 >> v2:172.21.15.153:3300/0 conn(0x7f2028070230 0x7f202806f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 -- 172.21.15.153:0/3803980185 >> 172.21.15.153:0/3803980185 conn(0x7f20280ceff0 msgr2=0x7f20280cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:51.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 -- 172.21.15.153:0/3803980185 shutdown_connections 2024-09-17T03:14:51.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.580+0000 7f2027e00640 1 -- 172.21.15.153:0/3803980185 wait complete. 2024-09-17T03:14:51.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.582+0000 7f2027e00640 1 Processor -- start 2024-09-17T03:14:51.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.582+0000 7f2027e00640 1 -- start start 2024-09-17T03:14:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 0x7f202815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 0x7f202815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20281601a0 con 0x7f202806fcb0 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2028160020 con 0x7f202815f830 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2028160320 con 0x7f2028070230 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48546/0 (socket says 172.21.15.153:48546) 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 -- 172.21.15.153:0/296612749 learned_addr learned my addr 172.21.15.153:0/296612749 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026000640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 0x7f202815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 -- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 msgr2=0x7f202815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 0x7f202815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2027400640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 0x7f202815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 -- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 msgr2=0x7f202815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.584+0000 7f2026a00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 0x7f202815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2026a00640 1 -- 172.21.15.153:0/296612749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202815d420 con 0x7f202806fcb0 2024-09-17T03:14:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2026000640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 0x7f202815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2027400640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 0x7f202815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2026a00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f201800e9c0 tx=0x7f201800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201800cd80 con 0x7f202806fcb0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2018004020 con 0x7f202806fcb0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018004450 con 0x7f202806fcb0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20280b14e0 con 0x7f202806fcb0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.585+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20280b1aa0 con 0x7f202806fcb0 2024-09-17T03:14:51.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.587+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202815f2f0 con 0x7f202806fcb0 2024-09-17T03:14:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.588+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20180035f0 con 0x7f202806fcb0 2024-09-17T03:14:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.589+0000 7f201ea00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 0x7f200807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.589+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f201809b8d0 con 0x7f202806fcb0 2024-09-17T03:14:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.589+0000 7f2026000640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 0x7f200807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.590+0000 7f2026000640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 0x7f200807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2014034000 tx=0x7f2014004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.598+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2018063af0 con 0x7f202806fcb0 2024-09-17T03:14:51.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.826+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20280d07d0 con 0x7f202806fcb0 2024-09-17T03:14:51.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.827+0000 7f201ea00640 1 -- 172.21.15.153:0/296612749 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5232 (secure 0 0 0) 0x7f20180633f0 con 0x7f202806fcb0 2024-09-17T03:14:51.826 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:51.826 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"btime":"2024-09-17T03:14:40:924795+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3190390573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3190390573},{"type":"v1","addr":"172.21.15.164:6836","nonce":3190390573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4939,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1750845241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1750845241},{"type":"v1","addr":"172.21.15.164:6837","nonce":1750845241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3449978034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3449978034},{"type":"v1","addr":"172.21.15.153:6834","nonce":3449978034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:40.410947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5004":{"gid":5004,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/402446814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":402446814},{"type":"v1","addr":"172.21.15.153:6835","nonce":402446814}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5004,"qdb_cluster":[5004]},"id":2}]} 2024-09-17T03:14:51.826 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 18 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 msgr2=0x7f200807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 0x7f200807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2014034000 tx=0x7f2014004730 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 msgr2=0x7f20280aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f201800e9c0 tx=0x7f201800ee80 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 shutdown_connections 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2008078b90 0x7f200807b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f202815f830 0x7f202815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2028070230 0x7f202815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 --2- 172.21.15.153:0/296612749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202806fcb0 0x7f20280aee60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 >> 172.21.15.153:0/296612749 conn(0x7f20280ceff0 msgr2=0x7f20280708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:51.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 shutdown_connections 2024-09-17T03:14:51.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:51.830+0000 7f2027e00640 1 -- 172.21.15.153:0/296612749 wait complete. 2024-09-17T03:14:52.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:37.396372+0000', 'modified': '2024-09-17T03:14:40.410947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5004}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5004': {'gid': 5004, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/402446814', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 402446814}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 402446814}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5004, 'qdb_cluster': [5004]} 2024-09-17T03:14:52.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:14:52.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:14:52.367 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-09-17T03:14:52.368+0000 7f842e800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 -- 172.21.15.153:0/2949676021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 msgr2=0x7f07480ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 --2- 172.21.15.153:0/2949676021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07480ce960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f074808d730 tx=0x7f073802a540 comp rx=0 tx=0).stop 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 -- 172.21.15.153:0/2949676021 shutdown_connections 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 --2- 172.21.15.153:0/2949676021 >> v2:172.21.15.164:3300/0 conn(0x7f07480d3600 0x7f074815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 --2- 172.21.15.153:0/2949676021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07480ce960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 -- 172.21.15.153:0/2949676021 >> 172.21.15.153:0/2949676021 conn(0x7f07480d4a20 msgr2=0x7f07480d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 -- 172.21.15.153:0/2949676021 shutdown_connections 2024-09-17T03:14:52.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.498+0000 7f0747200640 1 -- 172.21.15.153:0/2949676021 wait complete. 2024-09-17T03:14:52.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.500+0000 7f0747200640 1 Processor -- start 2024-09-17T03:14:52.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.500+0000 7f0747200640 1 -- start start 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.501+0000 7f0747200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07480b99e0 0x7f07481f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0747200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0747200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f074815a190 0x7f074815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0747200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f074815e870 con 0x7f07480d06e0 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0747200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f074815e6f0 con 0x7f074815a190 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0747200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f074815e9f0 con 0x7f07480b99e0 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48558/0 (socket says 172.21.15.153:48558) 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 -- 172.21.15.153:0/3102714112 learned_addr learned my addr 172.21.15.153:0/3102714112 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745e00640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07480b99e0 0x7f07481f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0746800640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f074815a190 0x7f074815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 -- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07480b99e0 msgr2=0x7f07481f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07480b99e0 0x7f07481f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 -- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f074815a190 msgr2=0x7f074815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f074815a190 0x7f074815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.502+0000 7f0745400640 1 -- 172.21.15.153:0/3102714112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074815b380 con 0x7f07480d06e0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f0745400640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f073400c430 tx=0x7f073400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f073e000640 1 -- 172.21.15.153:0/3102714112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734011790 con 0x7f07480d06e0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f073e000640 1 -- 172.21.15.153:0/3102714112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734017070 con 0x7f07480d06e0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f073e000640 1 -- 172.21.15.153:0/3102714112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734011ce0 con 0x7f07480d06e0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074815b660 con 0x7f07480d06e0 2024-09-17T03:14:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.503+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481f5e60 con 0x7f07480d06e0 2024-09-17T03:14:52.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.505+0000 7f073e000640 1 -- 172.21.15.153:0/3102714112 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f073401c460 con 0x7f07480d06e0 2024-09-17T03:14:52.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.506+0000 7f073e000640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 0x7f072807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.506+0000 7f073e000640 1 -- 172.21.15.153:0/3102714112 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7f073409add0 con 0x7f07480d06e0 2024-09-17T03:14:52.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.507+0000 7f07541d3740 1 Processor -- start 2024-09-17T03:14:52.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.507+0000 7f0745e00640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 0x7f072807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.507+0000 7f07541d3740 1 -- start start 2024-09-17T03:14:52.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.507+0000 7f0745e00640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 0x7f072807b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0738034000 tx=0x7f0738004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650d0a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560650c46430 con 0x5606508fb590 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560650c365d0 con 0x5606508f33b0 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560650c25a00 con 0x56065091c270 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f0745e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650d0a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.508+0000 7f0746800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48566/0 (socket says 172.21.15.153:48566) 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 -- 172.21.15.153:0/564705433 learned_addr learned my addr 172.21.15.153:0/564705433 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0745e00640 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650d0a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:52238/0 (socket says 172.21.15.153:52238) 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0745400640 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 -- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 msgr2=0x560650d0a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650d0a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 -- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 msgr2=0x560650cec970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cec970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 -- 172.21.15.153:0/564705433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560650bee520 con 0x5606508fb590 2024-09-17T03:14:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0746800640 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0740009f10 tx=0x7f07400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddfbb7ddfa07c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0732a00640 1 -- 172.21.15.153:0/564705433 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740003b70 con 0x5606508fb590 2024-09-17T03:14:52.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0732a00640 1 -- 172.21.15.153:0/564705433 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0740003e00 con 0x5606508fb590 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.509+0000 7f0732a00640 1 -- 172.21.15.153:0/564705433 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740004270 con 0x5606508fb590 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 -- 172.21.15.153:0/564705433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 msgr2=0x560650ceceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0740009f10 tx=0x7f07400107a0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 -- 172.21.15.153:0/564705433 shutdown_connections 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650ceceb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cec970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 --2- 172.21.15.153:0/564705433 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650d0a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 -- 172.21.15.153:0/564705433 >> 172.21.15.153:0/564705433 conn(0x5606509103c0 msgr2=0x560650cc2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 -- 172.21.15.153:0/564705433 shutdown_connections 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.510+0000 7f07541d3740 1 -- 172.21.15.153:0/564705433 wait complete. 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.511+0000 7f07541d3740 1 -- start start 2024-09-17T03:14:52.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.512+0000 7f07541d3740 1 Processor -- start 2024-09-17T03:14:52.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cefb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650cfa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560650bcc330 con 0x5606508fb590 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560650c29810 con 0x5606508f33b0 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560650996620 con 0x56065091c270 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f07541d3740 10 client.0 _ll_register_callbacks cb 0x560650bd1420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f0745400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.513+0000 7f0745400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48582/0 (socket says 172.21.15.153:48582) 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 -- 172.21.15.153:0/4014128276 learned_addr learned my addr 172.21.15.153:0/4014128276 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0746800640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650cfa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745e00640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cefb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 -- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 msgr2=0x560650cfa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650cfa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 -- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 msgr2=0x560650cefb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cefb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 -- 172.21.15.153:0/4014128276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560650987850 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0745400640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f073400cdf0 tx=0x7f0734062260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89426fccac6c4ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0727400640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073405e740 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7f0734061b00 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.514+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0740003e00 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0734062fa0 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 10 client.5232 fetch_fsmap learned FSMap version 21 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5606509fe6b0 con 0x5606508fb590 2024-09-17T03:14:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0740003e00 con 0x5606508fb590 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 21) ==== 3494+0+0 (secure 0 0 0) 0x7f073405e1f0 con 0x5606508fb590 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 10 client.5232 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 20 client.5232 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x5606508dae40 0x560650d00150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 4 client.5232 mds_command: new command op to 5155 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 --> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560650c38520 con 0x5606508dae40 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.515+0000 7f0745e00640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x5606508dae40 0x560650d00150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.516+0000 7f0745e00640 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x5606508dae40 0x560650d00150 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=ae2cf3ed59d3cb01 server_cookie=d56b3c9b11064135 in_seq=0 out_seq=0 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.516+0000 7f0727400640 10 client.5232 ms_handle_connect on v2:172.21.15.153:6832/8823958 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f0727400640 1 -- 172.21.15.153:0/4014128276 <== mds.? v2:172.21.15.153:6832/8823958 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24313 (crc 0 0 0) 0x560650c38520 con 0x5606508dae40 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f0727400640 10 client.5232 handle_command_reply: tid=0 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f07541d3740 1 client.5232 shutdown 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 msgr2=0x560650cfa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f073400cdf0 tx=0x7f0734062260 comp rx=0 tx=0).stop 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 shutdown_connections 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.517+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x5606508dae40 0x560650d00150 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56065091c270 0x560650cfa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508fb590 0x560650cfa410 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 --2- 172.21.15.153:0/4014128276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508f33b0 0x560650cefb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 >> 172.21.15.153:0/4014128276 conn(0x5606509103c0 msgr2=0x560650cec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f0727400640 0 client.5232 ms_handle_reset on v2:172.21.15.153:6832/8823958 2024-09-17T03:14:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 shutdown_connections 2024-09-17T03:14:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 1 -- 172.21.15.153:0/4014128276 wait complete. 2024-09-17T03:14:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.518+0000 7f07541d3740 20 client.5232 trim_cache size 0 max 16384 2024-09-17T03:14:52.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.537+0000 7f07541d3740 1 Processor -- start 2024-09-17T03:14:52.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.537+0000 7f07541d3740 1 -- start start 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508f33b0 0x560650cc2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 0x560650cc0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0748072900 con 0x56065091c270 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0748071c60 con 0x5606508fb590 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.538+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f07480722b0 con 0x5606508f33b0 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0746800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 0x560650cc0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508f33b0 0x560650cc2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:42894/0 (socket says 172.21.15.153:42894) 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 -- 172.21.15.153:0/1059188056 learned_addr learned my addr 172.21.15.153:0/1059188056 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0746800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 0x560650cc0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48596/0 (socket says 172.21.15.153:48596) 2024-09-17T03:14:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 -- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508f33b0 msgr2=0x560650cc2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508f33b0 0x560650cc2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 -- 172.21.15.153:0/1059188056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 msgr2=0x560650cc0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 0x560650cc0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 -- 172.21.15.153:0/1059188056 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560650cefdf0 con 0x5606508fb590 2024-09-17T03:14:52.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0745400640 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07340625a0 tx=0x7f0734021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0c5caa4f002256 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.539+0000 7f0732000640 1 -- 172.21.15.153:0/1059188056 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073405e740 con 0x5606508fb590 2024-09-17T03:14:52.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f0732000640 1 -- 172.21.15.153:0/1059188056 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734067070 con 0x5606508fb590 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f0732000640 1 -- 172.21.15.153:0/1059188056 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734062010 con 0x5606508fb590 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 -- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 msgr2=0x560650cc30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07340625a0 tx=0x7f0734021000 comp rx=0 tx=0).stop 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 -- 172.21.15.153:0/1059188056 shutdown_connections 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56065091c270 0x560650cc0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5606508fb590 0x560650cc30a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 --2- 172.21.15.153:0/1059188056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508f33b0 0x560650cc2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.540+0000 7f07541d3740 1 -- 172.21.15.153:0/1059188056 >> 172.21.15.153:0/1059188056 conn(0x5606509103c0 msgr2=0x560650cfba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.541+0000 7f07541d3740 1 -- 172.21.15.153:0/1059188056 shutdown_connections 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.541+0000 7f07541d3740 1 -- 172.21.15.153:0/1059188056 wait complete. 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.541+0000 7f07541d3740 1 -- start start 2024-09-17T03:14:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.542+0000 7f07541d3740 1 Processor -- start 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508fb590 0x560650d857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56065091c270 0x560650d00040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560650cff2d0 con 0x5606508f33b0 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560650cfee00 con 0x56065091c270 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560650d22b80 con 0x5606508fb590 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f07541d3740 10 client.0 _ll_register_callbacks cb 0x7f0734062740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f0745e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f0745e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48602/0 (socket says 172.21.15.153:48602) 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.543+0000 7f0745e00640 1 -- 172.21.15.153:0/3882221494 learned_addr learned my addr 172.21.15.153:0/3882221494 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745400640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508fb590 0x560650d857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0746800640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56065091c270 0x560650d00040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 -- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508fb590 msgr2=0x560650d857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508fb590 0x560650d857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 -- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56065091c270 msgr2=0x560650d00040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56065091c270 0x560650d00040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 -- 172.21.15.153:0/3882221494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560650d8f000 con 0x5606508f33b0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0745e00640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0738005eb0 tx=0x7f0738005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9530248ec2e8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0727400640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738054410 con 0x5606508f33b0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7f07380545b0 con 0x5606508f33b0 2024-09-17T03:14:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.544+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0734067070 con 0x5606508f33b0 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0738064050 con 0x5606508f33b0 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 10 client.5238 fetch_fsmap learned FSMap version 21 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x560650d85cf0 con 0x5606508f33b0 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734067070 con 0x5606508f33b0 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 21) ==== 3494+0+0 (secure 0 0 0) 0x7f0738067020 con 0x5606508f33b0 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 10 client.5238 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 20 client.5238 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x560650d93170 0x560650ced9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 4 client.5238 mds_command: new command op to 5155 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 --> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] -- command(tid 0: {"prefix": "status"}) -- 0x560650c33fd0 con 0x560650d93170 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.545+0000 7f0745400640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x560650d93170 0x560650ced9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f0745400640 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x560650d93170 0x560650ced9d0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=754f5ac30463c5f1 server_cookie=151f067a7b48e63a in_seq=0 out_seq=0 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f0727400640 10 client.5238 ms_handle_connect on v2:172.21.15.153:6832/8823958 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f0727400640 1 -- 172.21.15.153:0/3882221494 <== mds.? v2:172.21.15.153:6832/8823958 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x560650c33fd0 con 0x560650d93170 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f0727400640 10 client.5238 handle_command_reply: tid=0 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f07541d3740 1 client.5238 shutdown 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 msgr2=0x560650d16ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.546+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0738005eb0 tx=0x7f0738005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 shutdown_connections 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:6832/8823958,v1:172.21.15.153:6833/8823958] conn(0x560650d93170 0x560650ced9d0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56065091c270 0x560650d00040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5606508fb590 0x560650d857b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 --2- 172.21.15.153:0/3882221494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606508f33b0 0x560650d16ea0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f0727400640 0 client.5238 ms_handle_reset on v2:172.21.15.153:6832/8823958 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 >> 172.21.15.153:0/3882221494 conn(0x5606509103c0 msgr2=0x560650cfb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 shutdown_connections 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 1 -- 172.21.15.153:0/3882221494 wait complete. 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.547+0000 7f07541d3740 20 client.5238 trim_cache size 0 max 16384 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:14:52.549 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": -1, 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5155, 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:standby", 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:standby", 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 20, 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 0, 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 0, 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 0.99979669599999998 2024-09-17T03:14:52.550 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 msgr2=0x7f072807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 0x7f072807b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0738034000 tx=0x7f0738004730 comp rx=0 tx=0).stop 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 msgr2=0x7f07481f8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f073400c430 tx=0x7f073400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 shutdown_connections 2024-09-17T03:14:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0728078b90 0x7f072807b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f074815a190 0x7f074815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07480d06e0 0x7f07481f8860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 --2- 172.21.15.153:0/3102714112 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07480b99e0 0x7f07481f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 >> 172.21.15.153:0/3102714112 conn(0x7f07480d4a20 msgr2=0x7f0748161690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 shutdown_connections 2024-09-17T03:14:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:52.548+0000 7f0747200640 1 -- 172.21.15.153:0/3102714112 wait complete. 2024-09-17T03:14:52.688 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:52.692 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:53.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.795+0000 7ff4bc000640 1 -- 172.21.15.153:0/1681106684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff49c003a50 msgr2=0x7ff49c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.795+0000 7ff4bc000640 1 --2- 172.21.15.153:0/1681106684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff49c003a50 0x7ff49c003ec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800c7a0 tx=0x7ff49c005830 comp rx=0 tx=0).stop 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.796+0000 7ff4bc000640 1 -- 172.21.15.153:0/1681106684 shutdown_connections 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.796+0000 7ff4bc000640 1 --2- 172.21.15.153:0/1681106684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff49c003a50 0x7ff49c003ec0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.796+0000 7ff4bc000640 1 -- 172.21.15.153:0/1681106684 >> 172.21.15.153:0/1681106684 conn(0x7ff4b40b34b0 msgr2=0x7ff4b40b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.796+0000 7ff4bc000640 1 -- 172.21.15.153:0/1681106684 shutdown_connections 2024-09-17T03:14:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.796+0000 7ff4bc000640 1 -- 172.21.15.153:0/1681106684 wait complete. 2024-09-17T03:14:53.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.798+0000 7ff4bc000640 1 Processor -- start 2024-09-17T03:14:53.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.798+0000 7ff4bc000640 1 -- start start 2024-09-17T03:14:53.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c003a50 0x7ff4b41f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:53.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:53.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4b40b1810 0x7ff4b40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:53.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40cc450 con 0x7ff4b40cef10 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41570a0 con 0x7ff49c003a50 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4bc000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40cc5d0 con 0x7ff4b40b1810 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54644/0 (socket says 172.21.15.153:54644) 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 -- 172.21.15.153:0/356431512 learned_addr learned my addr 172.21.15.153:0/356431512 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4ba000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4b40b1810 0x7ff4b40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b9600640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c003a50 0x7ff4b41f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 -- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4b40b1810 msgr2=0x7ff4b40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4b40b1810 0x7ff4b40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 -- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c003a50 msgr2=0x7ff4b41f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c003a50 0x7ff4b41f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.800+0000 7ff4b8c00640 1 -- 172.21.15.153:0/356431512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b40cf860 con 0x7ff4b40cef10 2024-09-17T03:14:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4b8c00640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0004f00 tx=0x7ff4a0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0015020 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4a0011960 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b40b0090 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0011d90 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.801+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b40b0650 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.802+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b40d0560 con 0x7ff4b40cef10 2024-09-17T03:14:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.803+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4a0018020 con 0x7ff4b40cef10 2024-09-17T03:14:53.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.804+0000 7ff4b1600640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 0x7ff49407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:53.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.804+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7ff4a009ba00 con 0x7ff4b40cef10 2024-09-17T03:14:53.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.805+0000 7ff4b9600640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 0x7ff49407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:53.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.805+0000 7ff4b9600640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 0x7ff49407b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033000 tx=0x7ff4a8001fb0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:53.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:53.809+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4a001f020 con 0x7ff4b40cef10 2024-09-17T03:14:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.032+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4b40afe20 con 0x7ff4b40cef10 2024-09-17T03:14:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.033+0000 7ff4b1600640 1 -- 172.21.15.153:0/356431512 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5214 (secure 0 0 0) 0x7ff4b40cf860 con 0x7ff4b40cef10 2024-09-17T03:14:54.032 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:54.032 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"btime":"2024-09-17T03:14:53:381881+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:52.409907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-17T03:14:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 22 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 msgr2=0x7ff49407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 0x7ff49407b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8033000 tx=0x7ff4a8001fb0 comp rx=0 tx=0).stop 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 msgr2=0x7ff4b40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0004f00 tx=0x7ff4a0001630 comp rx=0 tx=0).stop 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 shutdown_connections 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff494078bc0 0x7ff49407b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff4b40b1810 0x7ff4b40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:54.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4b40cef10 0x7ff4b40cf320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:54.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 --2- 172.21.15.153:0/356431512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c003a50 0x7ff4b41f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:54.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 >> 172.21.15.153:0/356431512 conn(0x7ff4b40b34b0 msgr2=0x7ff4b415b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:54.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 shutdown_connections 2024-09-17T03:14:54.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:54.036+0000 7ff4bc000640 1 -- 172.21.15.153:0/356431512 wait complete. 2024-09-17T03:14:54.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:37.396372+0000', 'modified': '2024-09-17T03:14:52.409907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.153:6835/3384829696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3384829696}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3384829696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:14:54.460 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:reconnect 2024-09-17T03:14:55.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 -- 172.21.15.153:0/1931208367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 msgr2=0x7f6cb006f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1931208367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb006f820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00cdbc0 tx=0x7f6ca802aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 -- 172.21.15.153:0/1931208367 shutdown_connections 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1931208367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb006f820 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1931208367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 0x7f6cb006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1931208367 >> v2:172.21.15.164:3300/0 conn(0x7f6cb00708e0 0x7f6cb00cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 -- 172.21.15.153:0/1931208367 >> 172.21.15.153:0/1931208367 conn(0x7f6cb00b34b0 msgr2=0x7f6cb00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 -- 172.21.15.153:0/1931208367 shutdown_connections 2024-09-17T03:14:55.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.693+0000 7f6cb8600640 1 -- 172.21.15.153:0/1931208367 wait complete. 2024-09-17T03:14:55.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.696+0000 7f6cb8600640 1 Processor -- start 2024-09-17T03:14:55.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.696+0000 7f6cb8600640 1 -- start start 2024-09-17T03:14:55.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 0x7f6cb00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 0x7f6cb00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0070300 con 0x7f6cb006f410 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0070180 con 0x7f6cb00708e0 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb8600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb0072e70 con 0x7f6cb00cf930 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.697+0000 7f6cb5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54656/0 (socket says 172.21.15.153:54656) 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 -- 172.21.15.153:0/1489101710 learned_addr learned my addr 172.21.15.153:0/1489101710 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb6600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 0x7f6cb00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5200640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 0x7f6cb00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 -- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 msgr2=0x7f6cb00c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 0x7f6cb00c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 -- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 msgr2=0x7f6cb00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 0x7f6cb00c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 -- 172.21.15.153:0/1489101710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb009a160 con 0x7f6cb006f410 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5200640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 0x7f6cb00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cb5c00640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400d680 tx=0x7f6ca400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.698+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4017070 con 0x7f6cb006f410 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.699+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ca4004310 con 0x7f6cb006f410 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.699+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb009a660 con 0x7f6cb006f410 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.699+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4005280 con 0x7f6cb006f410 2024-09-17T03:14:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.699+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb00aecb0 con 0x7f6cb006f410 2024-09-17T03:14:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.700+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb015abe0 con 0x7f6cb006f410 2024-09-17T03:14:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.701+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ca4005420 con 0x7f6cb006f410 2024-09-17T03:14:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.702+0000 7f6cad600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 0x7f6c9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.702+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7f6ca409b220 con 0x7f6cb006f410 2024-09-17T03:14:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.702+0000 7f6cb5200640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 0x7f6c9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:55.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.703+0000 7f6cb5200640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 0x7f6c9007b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cb009ac20 tx=0x7f6c9c005ef0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.707+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ca4020020 con 0x7f6cb006f410 2024-09-17T03:14:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.926+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cb01f5650 con 0x7f6cb006f410 2024-09-17T03:14:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.927+0000 7f6cad600640 1 -- 172.21.15.153:0/1489101710 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5217 (secure 0 0 0) 0x7f6ca4063480 con 0x7f6cb006f410 2024-09-17T03:14:55.926 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:55.926 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":24,"btime":"2024-09-17T03:14:55:388624+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:54.391994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-17T03:14:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 24 2024-09-17T03:14:55.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 msgr2=0x7f6c9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 0x7f6c9007b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cb009ac20 tx=0x7f6c9c005ef0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 msgr2=0x7f6cb01f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400d680 tx=0x7f6ca400db40 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 shutdown_connections 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6c90078bc0 0x7f6c9007b0d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6cb00cf930 0x7f6cb00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6cb00708e0 0x7f6cb00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 --2- 172.21.15.153:0/1489101710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb006f410 0x7f6cb01f5110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 >> 172.21.15.153:0/1489101710 conn(0x7f6cb00b34b0 msgr2=0x7f6cb00afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 shutdown_connections 2024-09-17T03:14:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:55.929+0000 7f6cb8600640 1 -- 172.21.15.153:0/1489101710 wait complete. 2024-09-17T03:14:56.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:37.396372+0000', 'modified': '2024-09-17T03:14:54.391994+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.153:6835/3384829696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3384829696}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3384829696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:14:56.352 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:clientreplay 2024-09-17T03:14:57.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:57.389 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-09-17T03:14:57.390+0000 7f9aa2c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:14:57.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1106097762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88004800 msgr2=0x7f2a88004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1106097762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a88004800 0x7f2a88004c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c2e0 tx=0x7f2a88005830 comp rx=0 tx=0).stop 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa2800640 1 -- 172.21.15.153:0/1106097762 reap_dead start 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1106097762 shutdown_connections 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1106097762 >> 172.21.15.153:0/1106097762 conn(0x7f2aa40b34b0 msgr2=0x7f2aa40b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1106097762 shutdown_connections 2024-09-17T03:14:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.590+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1106097762 wait complete. 2024-09-17T03:14:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.593+0000 7f2aa8c00640 1 Processor -- start 2024-09-17T03:14:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.593+0000 7f2aa8c00640 1 -- start start 2024-09-17T03:14:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 0x7f2aa4159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 0x7f2aa415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa40cb2e0 con 0x7f2aa41f93b0 2024-09-17T03:14:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa40cb160 con 0x7f2aa415a550 2024-09-17T03:14:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2aa8c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa40cb460 con 0x7f2a88004800 2024-09-17T03:14:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2a99400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2a99400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54686/0 (socket says 172.21.15.153:54686) 2024-09-17T03:14:57.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.594+0000 7f2a99400640 1 -- 172.21.15.153:0/1939153197 learned_addr learned my addr 172.21.15.153:0/1939153197 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2aa1e00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 0x7f2aa4159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 -- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 msgr2=0x7f2aa4159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2aa2800640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 0x7f2aa415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 0x7f2aa4159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 -- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 msgr2=0x7f2aa415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 0x7f2aa415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 -- 172.21.15.153:0/1939153197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa40c68c0 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2aa1e00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 0x7f2aa4159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2aa2800640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 0x7f2aa415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a99400640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c400 tx=0x7f2a8c006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c031040 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a8c0065a0 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.595+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa41f88d0 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.596+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c003a60 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.596+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa41f8e90 con 0x7f2aa41f93b0 2024-09-17T03:14:57.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.596+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa40cb9f0 con 0x7f2aa41f93b0 2024-09-17T03:14:57.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.598+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a8c034070 con 0x7f2aa41f93b0 2024-09-17T03:14:57.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.599+0000 7f2a9aa00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 0x7f2a8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:57.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.599+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7f2a8c0bb130 con 0x7f2aa41f93b0 2024-09-17T03:14:57.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.599+0000 7f2aa1e00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 0x7f2a8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:57.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.600+0000 7f2aa1e00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 0x7f2a8007b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009b40 tx=0x7f2a94005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:57.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.603+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2a8c083380 con 0x7f2aa41f93b0 2024-09-17T03:14:57.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.825+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2aa40cd250 con 0x7f2aa41f93b0 2024-09-17T03:14:57.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.826+0000 7f2a9aa00640 1 -- 172.21.15.153:0/1939153197 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7f2a8c082c80 con 0x7f2aa41f93b0 2024-09-17T03:14:57.825 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:14:57.825 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":25,"btime":"2024-09-17T03:14:56:401155+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:56.401147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-09-17T03:14:57.825 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 25 2024-09-17T03:14:57.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 msgr2=0x7f2a8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:57.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 0x7f2a8007b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009b40 tx=0x7f2a94005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 msgr2=0x7f2aa415ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c400 tx=0x7f2a8c006d90 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 shutdown_connections 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2a80078b90 0x7f2a8007b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2aa415a550 0x7f2aa415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aa41f93b0 0x7f2aa415ab30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 --2- 172.21.15.153:0/1939153197 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2a88004800 0x7f2aa4159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 >> 172.21.15.153:0/1939153197 conn(0x7f2aa40b34b0 msgr2=0x7f2aa41eaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 shutdown_connections 2024-09-17T03:14:57.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:57.828+0000 7f2aa8c00640 1 -- 172.21.15.153:0/1939153197 wait complete. 2024-09-17T03:14:58.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:37.396372+0000', 'modified': '2024-09-17T03:14:56.401147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 44, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.153:6835/3384829696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3384829696}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3384829696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5211, 'qdb_cluster': [5211]} 2024-09-17T03:14:58.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:14:58.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:14:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 -- 172.21.15.153:0/2609062511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006e450 msgr2=0x7fd56015c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 --2- 172.21.15.153:0/2609062511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006e450 0x7fd56015c8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd560072c70 tx=0x7fd54c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 -- 172.21.15.153:0/2609062511 shutdown_connections 2024-09-17T03:14:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 --2- 172.21.15.153:0/2609062511 >> v2:172.21.15.164:3300/0 conn(0x7fd5600706e0 0x7fd5600ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 --2- 172.21.15.153:0/2609062511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006e450 0x7fd56015c8b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 -- 172.21.15.153:0/2609062511 >> 172.21.15.153:0/2609062511 conn(0x7fd5600b1c50 msgr2=0x7fd5600b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 -- 172.21.15.153:0/2609062511 shutdown_connections 2024-09-17T03:14:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.478+0000 7fd568400640 1 -- 172.21.15.153:0/2609062511 wait complete. 2024-09-17T03:14:58.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.480+0000 7fd568400640 1 Processor -- start 2024-09-17T03:14:58.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.480+0000 7fd568400640 1 -- start start 2024-09-17T03:14:58.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 0x7fd5600c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5600c7c20 0x7fd5600c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd560074690 con 0x7fd56006ed40 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd560074510 con 0x7fd5600c7c20 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd568400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd560074810 con 0x7fd5600706e0 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54716/0 (socket says 172.21.15.153:54716) 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 -- 172.21.15.153:0/1588980673 learned_addr learned my addr 172.21.15.153:0/1588980673 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565000640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 0x7fd5600c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd566400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5600c7c20 0x7fd5600c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 -- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 msgr2=0x7fd5600c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 0x7fd5600c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 -- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5600c7c20 msgr2=0x7fd5600c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5600c7c20 0x7fd5600c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565a00640 1 -- 172.21.15.153:0/1588980673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5600b5d90 con 0x7fd56006ed40 2024-09-17T03:14:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.482+0000 7fd565000640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 0x7fd5600c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd565a00640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd55400b410 tx=0x7fd55400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd55d600640 1 -- 172.21.15.153:0/1588980673 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554015020 con 0x7fd56006ed40 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd55d600640 1 -- 172.21.15.153:0/1588980673 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd554011920 con 0x7fd56006ed40 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5600b5210 con 0x7fd56006ed40 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd55d600640 1 -- 172.21.15.153:0/1588980673 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554011d70 con 0x7fd56006ed40 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.483+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5600b57d0 con 0x7fd56006ed40 2024-09-17T03:14:58.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.485+0000 7fd55d600640 1 -- 172.21.15.153:0/1588980673 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd554018020 con 0x7fd56006ed40 2024-09-17T03:14:58.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.486+0000 7fd55d600640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.486+0000 7fd55d600640 1 -- 172.21.15.153:0/1588980673 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7fd55409ae70 con 0x7fd56006ed40 2024-09-17T03:14:58.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.487+0000 7fd56f4ac740 1 Processor -- start 2024-09-17T03:14:58.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.487+0000 7fd565000640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.487+0000 7fd56f4ac740 1 -- start start 2024-09-17T03:14:58.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd565000640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 0x7fd54007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd54c033000 tx=0x7fd54c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd170f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eedd0fa430 con 0x55eedcdd0270 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eedd0ea5d0 con 0x55eedcda73b0 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55eedd0d9a00 con 0x55eedcdaf590 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd565a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd565a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54722/0 (socket says 172.21.15.153:54722) 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.488+0000 7fd565a00640 1 -- 172.21.15.153:0/1259513315 learned_addr learned my addr 172.21.15.153:0/1259513315 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd566400640 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565000640 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd170f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 -- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 msgr2=0x55eedd1714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 -- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 msgr2=0x55eedd170f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd170f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 -- 172.21.15.153:0/1259513315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eedd0a2520 con 0x55eedcdd0270 2024-09-17T03:14:58.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd565a00640 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd554062950 tx=0x7fd554062230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a349535bbc66a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd552000640 1 -- 172.21.15.153:0/1259513315 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540674a0 con 0x55eedcdd0270 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd552000640 1 -- 172.21.15.153:0/1259513315 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd55406c350 con 0x55eedcdd0270 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.489+0000 7fd552000640 1 -- 172.21.15.153:0/1259513315 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554067100 con 0x55eedcdd0270 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1259513315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 msgr2=0x55eedd1bba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd554062950 tx=0x7fd554062230 comp rx=0 tx=0).stop 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1259513315 shutdown_connections 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1259513315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1bba20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1259513315 >> 172.21.15.153:0/1259513315 conn(0x55eedcdc43c0 msgr2=0x55eedd176970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1259513315 shutdown_connections 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.490+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1259513315 wait complete. 2024-09-17T03:14:58.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.491+0000 7fd56f4ac740 1 -- start start 2024-09-17T03:14:58.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.492+0000 7fd56f4ac740 1 Processor -- start 2024-09-17T03:14:58.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eedd080330 con 0x55eedcdd0270 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eedd0dd810 con 0x55eedcda73b0 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55eedce4a620 con 0x55eedcdaf590 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd56f4ac740 10 client.0 _ll_register_callbacks cb 0x55eedd085420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd566400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd566400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54732/0 (socket says 172.21.15.153:54732) 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.493+0000 7fd566400640 1 -- 172.21.15.153:0/3079285514 learned_addr learned my addr 172.21.15.153:0/3079285514 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd565a00640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd565000640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 -- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 msgr2=0x55eedd1d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 -- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 msgr2=0x55eedd1cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 -- 172.21.15.153:0/3079285514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eedce3b850 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd565a00640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd566400640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd558011a60 tx=0x7fd558011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b19773bdd6d9ce server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd546a00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55801e060 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7fd55800fe10 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.494+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd55406c350 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd558004b20 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 10 client.5268 fetch_fsmap learned FSMap version 25 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55eedceb26b0 con 0x55eedcdd0270 2024-09-17T03:14:58.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd55406c350 con 0x55eedcdd0270 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd558018030 con 0x55eedcdd0270 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 10 client.5268 fetch_fsmap finished waiting for FSMap version 25 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 10 client.5268 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 20 client.5268 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedcd8ee40 0x55eedd18fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 4 client.5268 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 --> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eedd0ec520 con 0x55eedcd8ee40 2024-09-17T03:14:58.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.495+0000 7fd565a00640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedcd8ee40 0x55eedd18fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.496+0000 7fd565a00640 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedcd8ee40 0x55eedd18fcf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f53fdece944d15 server_cookie=a2a53baf1150819c in_seq=0 out_seq=0 2024-09-17T03:14:58.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.496+0000 7fd546a00640 10 client.5268 ms_handle_connect on v2:172.21.15.153:6834/3384829696 2024-09-17T03:14:58.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd546a00640 1 -- 172.21.15.153:0/3079285514 <== mds.0 v2:172.21.15.153:6834/3384829696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eedd0ec520 con 0x55eedcd8ee40 2024-09-17T03:14:58.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd546a00640 10 client.5268 handle_command_reply: tid=0 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 client.5268 shutdown 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 msgr2=0x55eedd19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd558011a60 tx=0x7fd558011f20 comp rx=0 tx=0).stop 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 shutdown_connections 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedcd8ee40 0x55eedd18fcf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd19fc00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3079285514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd546a00640 0 client.5268 ms_handle_reset on v2:172.21.15.153:6834/3384829696 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 >> 172.21.15.153:0/3079285514 conn(0x55eedcdc43c0 msgr2=0x55eedd1bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 shutdown_connections 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3079285514 wait complete. 2024-09-17T03:14:58.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.497+0000 7fd56f4ac740 20 client.5268 trim_cache size 0 max 16384 2024-09-17T03:14:58.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.516+0000 7fd56f4ac740 1 Processor -- start 2024-09-17T03:14:58.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.516+0000 7fd56f4ac740 1 -- start start 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 0x55eedd1bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcdd0270 0x55eedd1e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600cfc10 con 0x55eedcdaf590 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600cef70 con 0x55eedcdd0270 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd5600cf5c0 con 0x55eedcda73b0 2024-09-17T03:14:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54734/0 (socket says 172.21.15.153:54734) 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 -- 172.21.15.153:0/3012568599 learned_addr learned my addr 172.21.15.153:0/3012568599 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565a00640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 0x55eedd1bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd566400640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcdd0270 0x55eedd1e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 -- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 msgr2=0x55eedd1bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 0x55eedd1bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 -- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcdd0270 msgr2=0x55eedd1e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcdd0270 0x55eedd1e3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565000640 1 -- 172.21.15.153:0/3012568599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eedd1a0c30 con 0x55eedcdaf590 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.518+0000 7fd565a00640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 0x55eedd1bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.519+0000 7fd565000640 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0099c0 tx=0x7fd54c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1221e064961807 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.519+0000 7fd551600640 1 -- 172.21.15.153:0/3012568599 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c035040 con 0x55eedcdaf590 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.519+0000 7fd551600640 1 -- 172.21.15.153:0/3012568599 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd54c0047a0 con 0x55eedcdaf590 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.519+0000 7fd551600640 1 -- 172.21.15.153:0/3012568599 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004bd0 con 0x55eedcdaf590 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3012568599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 msgr2=0x55eedd1e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0099c0 tx=0x7fd54c03c000 comp rx=0 tx=0).stop 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3012568599 shutdown_connections 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcdd0270 0x55eedd1e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdaf590 0x55eedd1e3810 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/3012568599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcda73b0 0x55eedd1bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3012568599 >> 172.21.15.153:0/3012568599 conn(0x55eedcdc43c0 msgr2=0x55eedd1b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3012568599 shutdown_connections 2024-09-17T03:14:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.520+0000 7fd56f4ac740 1 -- 172.21.15.153:0/3012568599 wait complete. 2024-09-17T03:14:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.521+0000 7fd56f4ac740 1 -- start start 2024-09-17T03:14:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.521+0000 7fd56f4ac740 1 Processor -- start 2024-09-17T03:14:58.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1d3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eedd1cf220 con 0x55eedcdd0270 2024-09-17T03:14:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eedd1bf6b0 con 0x55eedcda73b0 2024-09-17T03:14:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55eedd1bf9e0 con 0x55eedcdaf590 2024-09-17T03:14:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.522+0000 7fd56f4ac740 10 client.0 _ll_register_callbacks cb 0x7fd558011670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54748/0 (socket says 172.21.15.153:54748) 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 -- 172.21.15.153:0/1170674277 learned_addr learned my addr 172.21.15.153:0/1170674277 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd565a00640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd565000640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 -- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 msgr2=0x55eedd1d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 -- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 msgr2=0x55eedd1d3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:58.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1d3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 -- 172.21.15.153:0/1170674277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eedd1be550 con 0x55eedcdd0270 2024-09-17T03:14:58.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd566400640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd558011780 tx=0x7fd558005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eca06d40813201 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:58.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.523+0000 7fd546a00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55801e040 con 0x55eedcdd0270 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6187+0+0 (secure 0 0 0) 0x7fd5580055a0 con 0x55eedcdd0270 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd54c0047a0 con 0x55eedcdd0270 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd558036050 con 0x55eedcdd0270 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd56f4ac740 10 client.5274 fetch_fsmap learned FSMap version 25 2024-09-17T03:14:58.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55eedd19d860 con 0x55eedcdd0270 2024-09-17T03:14:58.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd54c0047a0 con 0x55eedcdd0270 2024-09-17T03:14:58.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fd558039020 con 0x55eedcdd0270 2024-09-17T03:14:58.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd56f4ac740 10 client.5274 fetch_fsmap finished waiting for FSMap version 25 2024-09-17T03:14:58.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.524+0000 7fd56f4ac740 10 client.5274 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:14:58.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd56f4ac740 20 client.5274 populate_metadata read hostname 'smithi153' 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedd1b3e10 0x55eedd18e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd56f4ac740 4 client.5274 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 --> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] -- command(tid 0: {"prefix": "status"}) -- 0x55eedd0e7fd0 con 0x55eedd1b3e10 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd565a00640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedd1b3e10 0x55eedd18e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd565a00640 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedd1b3e10 0x55eedd18e5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d722fc69175568 server_cookie=86ad77c6327146ec in_seq=0 out_seq=0 2024-09-17T03:14:58.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd546a00640 10 client.5274 ms_handle_connect on v2:172.21.15.153:6834/3384829696 2024-09-17T03:14:58.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd546a00640 1 -- 172.21.15.153:0/1170674277 <== mds.0 v2:172.21.15.153:6834/3384829696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55eedd0e7fd0 con 0x55eedd1b3e10 2024-09-17T03:14:58.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd546a00640 10 client.5274 handle_command_reply: tid=0 2024-09-17T03:14:58.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.525+0000 7fd56f4ac740 1 client.5274 shutdown 2024-09-17T03:14:58.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 msgr2=0x55eedd1e3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd558011780 tx=0x7fd558005120 comp rx=0 tx=0).stop 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 shutdown_connections 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:6834/3384829696,v1:172.21.15.153:6835/3384829696] conn(0x55eedd1b3e10 0x55eedd18e5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eedcdd0270 0x55eedd1e3c50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55eedcdaf590 0x55eedd1d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd546a00640 0 client.5274 ms_handle_reset on v2:172.21.15.153:6834/3384829696 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 --2- 172.21.15.153:0/1170674277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eedcda73b0 0x55eedd1d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 >> 172.21.15.153:0/1170674277 conn(0x55eedcdc43c0 msgr2=0x55eedd1b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 shutdown_connections 2024-09-17T03:14:58.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 1 -- 172.21.15.153:0/1170674277 wait complete. 2024-09-17T03:14:58.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.526+0000 7fd56f4ac740 20 client.5274 trim_cache size 0 max 16384 2024-09-17T03:14:58.539 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5211, 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:14:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.1441979150000003, 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 25, 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 45, 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 6.9646879869999996 2024-09-17T03:14:58.541 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:14:58.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 msgr2=0x7fd54007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 0x7fd54007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd54c033000 tx=0x7fd54c004730 comp rx=0 tx=0).stop 2024-09-17T03:14:58.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 msgr2=0x7fd5601f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:58.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd55400b410 tx=0x7fd55400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 shutdown_connections 2024-09-17T03:14:58.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd540078b90 0x7fd54007b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5600c7c20 0x7fd5600c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd5600706e0 0x7fd5600c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 --2- 172.21.15.153:0/1588980673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd56006ed40 0x7fd5601f2b70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:58.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 >> 172.21.15.153:0/1588980673 conn(0x7fd5600b1c50 msgr2=0x7fd5600c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:58.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 shutdown_connections 2024-09-17T03:14:58.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:14:58.527+0000 7fd568400640 1 -- 172.21.15.153:0/1588980673 wait complete. 2024-09-17T03:14:58.547 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:58.547 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file0", '"'"'w'"'"') as f: 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:14:58.584 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:14:58.585 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:14:58.628 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-09-17T03:14:58.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:14:58.664 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file0': No such file or directory 2024-09-17T03:14:58.733 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:14:59.665 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-09-17T03:14:59.703 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:14:59.704 INFO:tasks.cephfs.mount:File open_file0 became visible with size 7 from 0 after 1s 2024-09-17T03:14:59.704 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:59.704 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:59.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:59.781 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:14:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:14:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:14:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023923 s, 43.8 MB/s 2024-09-17T03:14:59.887 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:14:59.888 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:59.923 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:14:59.923 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:14:59.923 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file1", '"'"'w'"'"') as f: 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:14:59.924 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:14:59.925 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:14:59.967 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-09-17T03:15:00.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:00.003 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file1': No such file or directory 2024-09-17T03:15:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:00.735 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:01.003 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-09-17T03:15:01.042 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:01.042 INFO:tasks.cephfs.mount:File open_file1 became visible with size 7 from 0 after 1s 2024-09-17T03:15:01.042 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:01.042 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:01.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:01.120 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:01.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:01.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:01.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292409 s, 35.9 MB/s 2024-09-17T03:15:01.234 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:01.234 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:01.270 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file2", '"'"'w'"'"') as f: 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:01.271 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:01.314 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-09-17T03:15:01.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file2': No such file or directory 2024-09-17T03:15:01.412 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:02.068 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:02.352 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-09-17T03:15:02.388 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:02.389 INFO:tasks.cephfs.mount:File open_file2 became visible with size 7 from 0 after 1s 2024-09-17T03:15:02.389 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:02.389 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:02.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:02.466 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:02.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:02.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:02.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230595 s, 45.5 MB/s 2024-09-17T03:15:02.570 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:02.570 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:02.605 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:02.605 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file3", '"'"'w'"'"') as f: 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:02.606 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:02.607 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:02.607 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:02.607 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:02.607 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:02.607 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:02.650 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-09-17T03:15:02.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:02.687 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file3': No such file or directory 2024-09-17T03:15:02.736 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:03.414 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:03.688 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-09-17T03:15:03.726 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:03.726 INFO:tasks.cephfs.mount:File open_file3 became visible with size 7 from 0 after 1s 2024-09-17T03:15:03.727 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:03.727 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:03.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:03.804 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:03.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:03.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:03.908 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215155 s, 48.7 MB/s 2024-09-17T03:15:03.909 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:03.909 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file4", '"'"'w'"'"') as f: 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:03.946 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:03.947 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:03.990 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-09-17T03:15:04.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file4': No such file or directory 2024-09-17T03:15:04.069 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:04.739 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:04.753 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:05.030 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-09-17T03:15:05.073 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:05.074 INFO:tasks.cephfs.mount:File open_file4 became visible with size 7 from 0 after 1s 2024-09-17T03:15:05.074 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:05.074 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:05.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:05.152 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:05.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:05.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:05.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167782 s, 62.5 MB/s 2024-09-17T03:15:05.254 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:05.254 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:05.290 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:05.290 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:05.290 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:05.290 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:05.290 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file5", '"'"'w'"'"') as f: 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:05.291 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:05.292 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:05.336 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-09-17T03:15:05.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:05.372 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file5': No such file or directory 2024-09-17T03:15:05.416 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:05.434 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:06.072 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:06.092 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:06.374 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-09-17T03:15:06.414 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:06.415 INFO:tasks.cephfs.mount:File open_file5 became visible with size 7 from 0 after 1s 2024-09-17T03:15:06.415 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:06.415 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:06.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:06.494 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:06.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:06.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:06.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203673 s, 51.5 MB/s 2024-09-17T03:15:06.597 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:06.597 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file6", '"'"'w'"'"') as f: 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:06.633 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:06.634 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:06.677 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-09-17T03:15:06.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:06.714 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file6': No such file or directory 2024-09-17T03:15:06.741 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:06.754 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:07.418 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:07.436 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:07.715 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-09-17T03:15:07.755 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:07.755 INFO:tasks.cephfs.mount:File open_file6 became visible with size 7 from 0 after 1s 2024-09-17T03:15:07.755 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:07.755 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:07.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:07.832 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:07.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:07.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:07.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189171 s, 55.4 MB/s 2024-09-17T03:15:07.936 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:07.936 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/open_file7", '"'"'w'"'"') as f: 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:15:07.973 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:15:07.974 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:15:08.017 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-09-17T03:15:08.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:08.054 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file7': No such file or directory 2024-09-17T03:15:08.073 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:08.094 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:08.114 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:08.743 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:08.756 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:08.776 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:09.054 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-09-17T03:15:09.094 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:15:09.094 INFO:tasks.cephfs.mount:File open_file7 became visible with size 7 from 0 after 1s 2024-09-17T03:15:09.094 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:09.094 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:09.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:09.171 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:15:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-17T03:15:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-17T03:15:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195958 s, 53.5 MB/s 2024-09-17T03:15:09.420 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:09.438 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.076 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.096 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.117 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.745 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.759 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:10.779 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:11.422 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.119 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:12.781 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:13.423 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.080 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.749 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.763 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:15.426 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.102 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:16.785 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:17.428 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:17.446 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.084 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.104 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.767 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:19.276 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.1 2024-09-17T03:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.426+0000 7f9bcf842f40 1 Processor -- start 2024-09-17T03:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.427+0000 7f9bcf842f40 1 -- start start 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b85f0 0x557cde12dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 0x557cde12e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557cde0901d0 con 0x557cde1b7f90 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557cde09cf90 con 0x557cde1b85f0 2024-09-17T03:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x557cde031c60 con 0x557cde1b8a00 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bc8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bc8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55026/0 (socket says 172.21.15.153:55026) 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bc8a00640 1 -- 172.21.15.153:0/468255826 learned_addr learned my addr 172.21.15.153:0/468255826 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bc3e00640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b85f0 0x557cde12dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.428+0000 7f9bc9400640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 0x557cde12e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 -- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 msgr2=0x557cde12e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 0x557cde12e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 -- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b85f0 msgr2=0x557cde12dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b85f0 0x557cde12dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 -- 172.21.15.153:0/468255826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde1112c0 con 0x557cde1b7f90 2024-09-17T03:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc9400640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 0x557cde12e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001db0 tx=0x7f9bbc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691eacac953be36f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc2a00640 1 -- 172.21.15.153:0/468255826 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00bde0 con 0x557cde1b7f90 2024-09-17T03:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc2a00640 1 -- 172.21.15.153:0/468255826 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bbc00f400 con 0x557cde1b7f90 2024-09-17T03:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.429+0000 7f9bc2a00640 1 -- 172.21.15.153:0/468255826 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00f850 con 0x557cde1b7f90 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 -- 172.21.15.153:0/468255826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 msgr2=0x557cde1abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001db0 tx=0x7f9bbc00b5b0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 -- 172.21.15.153:0/468255826 shutdown_connections 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b8a00 0x557cde12e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b85f0 0x557cde12dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/468255826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b7f90 0x557cde1abb20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 -- 172.21.15.153:0/468255826 >> 172.21.15.153:0/468255826 conn(0x557cde002ac0 msgr2=0x557cde113220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 -- 172.21.15.153:0/468255826 shutdown_connections 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.430+0000 7f9bcf842f40 1 -- 172.21.15.153:0/468255826 wait complete. 2024-09-17T03:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.431+0000 7f9bcf842f40 1 Processor -- start 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.431+0000 7f9bcf842f40 1 -- start start 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b7f90 0x557cde1a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 0x557cde1b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b8a00 0x557cde253f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557cde1b6960 con 0x557cde1b85f0 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557cde1b6c40 con 0x557cde1b8a00 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bcf842f40 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x557cde1b3190 con 0x557cde1b7f90 2024-09-17T03:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 0x557cde1b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 0x557cde1b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55030/0 (socket says 172.21.15.153:55030) 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 -- 172.21.15.153:0/969722512 learned_addr learned my addr 172.21.15.153:0/969722512 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b7f90 0x557cde1a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc9400640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b8a00 0x557cde253f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 -- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b7f90 msgr2=0x557cde1a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557cde1b7f90 0x557cde1a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.433+0000 7f9bc3e00640 1 -- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b8a00 msgr2=0x557cde253f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc3e00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b8a00 0x557cde253f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc3e00640 1 -- 172.21.15.153:0/969722512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde1b4140 con 0x557cde1b85f0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc9400640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557cde1b8a00 0x557cde253f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc3e00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 0x557cde1b5fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4046560 tx=0x7f9bb404d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc1600640 1 -- 172.21.15.153:0/969722512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4066030 con 0x557cde1b85f0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc1600640 1 -- 172.21.15.153:0/969722512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bb4056470 con 0x557cde1b85f0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cde1b4420 con 0x557cde1b85f0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bc1600640 1 -- 172.21.15.153:0/969722512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4056620 con 0x557cde1b85f0 2024-09-17T03:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.434+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cde1b2ed0 con 0x557cde1b85f0 2024-09-17T03:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.436+0000 7f9bc1600640 1 -- 172.21.15.153:0/969722512 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bb4069070 con 0x557cde1b85f0 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.437+0000 7f9bc1600640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ba8077570 0x7f9ba8079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.437+0000 7f9bc1600640 1 -- 172.21.15.153:0/969722512 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f9bb40dddd0 con 0x557cde1b85f0 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.438+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x557cde1b1e50 0x557cde1b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.438+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 --> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] -- osd_op(unknown.0.0:1 5.13 5:c9647462:::mds0_openfiles.1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47) -- 0x557cde1b7510 con 0x557cde1b1e50 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.438+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ba8077570 0x7f9ba8079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.438+0000 7f9bc9400640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x557cde1b1e50 0x557cde1b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.439+0000 7f9bc8a00640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ba8077570 0x7f9ba8079a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc003040 tx=0x7f9bbc001080 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.439+0000 7f9bc9400640 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x557cde1b1e50 0x557cde1b2260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.439+0000 7f9bc9400640 1 -- 172.21.15.153:0/969722512 <== osd.4 v2:172.21.15.164:6810/4054245927 1 ==== osd_op_reply(1 mds0_openfiles.1 [stat out=16b] v0'0 uv9 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7f9bc4002860 con 0x557cde1b1e50 2024-09-17T03:15:19.439 INFO:teuthology.orchestra.run.smithi153.stdout:cephfs_metadata/mds0_openfiles.1 mtime 2024-09-17T03:15:09.000000+0000, size 0 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x557cde1b1e50 msgr2=0x557cde1b2260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x557cde1b1e50 0x557cde1b2260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ba8077570 msgr2=0x7f9ba8079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9ba8077570 0x7f9ba8079a80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc003040 tx=0x7f9bbc001080 comp rx=0 tx=0).stop 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 msgr2=0x557cde1b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 --2- 172.21.15.153:0/969722512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557cde1b85f0 0x557cde1b5fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4046560 tx=0x7f9bb404d6c0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bc9400640 1 -- 172.21.15.153:0/969722512 reap_dead start 2024-09-17T03:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 shutdown_connections 2024-09-17T03:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 >> 172.21.15.153:0/969722512 conn(0x557cde002ac0 msgr2=0x557cde1124b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 shutdown_connections 2024-09-17T03:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19.440+0000 7f9bcf842f40 1 -- 172.21.15.153:0/969722512 wait complete. 2024-09-17T03:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:19.452 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:15:19.452 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:19.548 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:19.648 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:15:19.648 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:19.648 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file0", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:19.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:19 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.755 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:20.768 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.770 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file1", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:20.788 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:20.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:20 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:21.432 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:21.450 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.087 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:22.103 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file2", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:22.108 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:22 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:22.127 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.771 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.791 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:22.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:22.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:23.449 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file3", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:23.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:23 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:23.451 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:24.129 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:24.773 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:24.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:24.789 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file4", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:24 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:26.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:26.127 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file5", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:26.131 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:26.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:26 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:27.456 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:27.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:27.473 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file6", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:27.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:27 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:28.797 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:28.813 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file7", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:15:28.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:28 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:15:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:15:30.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:30.153 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:30.153 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:30.236 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:30.236 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:30.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:15:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 -- 172.21.15.153:0/1958410758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95800cb500 msgr2=0x7f958015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 --2- 172.21.15.153:0/1958410758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95800cb500 0x7f958015d570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9578005fd0 tx=0x7f957802a940 comp rx=0 tx=0).stop 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 -- 172.21.15.153:0/1958410758 shutdown_connections 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 --2- 172.21.15.153:0/1958410758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95800cb500 0x7f958015d570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 -- 172.21.15.153:0/1958410758 >> 172.21.15.153:0/1958410758 conn(0x7f95800cc910 msgr2=0x7f95800ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 -- 172.21.15.153:0/1958410758 shutdown_connections 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.588+0000 7f9585200640 1 -- 172.21.15.153:0/1958410758 wait complete. 2024-09-17T03:15:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.590+0000 7f9585200640 1 Processor -- start 2024-09-17T03:15:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.590+0000 7f9585200640 1 -- start start 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f958015d160 0x7f95800b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 0x7f95800b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95800c5d60 con 0x7f9580073db0 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f95800c5be0 con 0x7f9580154d30 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9585200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f95800c5ee0 con 0x7f958015d160 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45684/0 (socket says 172.21.15.153:45684) 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 -- 172.21.15.153:0/2647323405 learned_addr learned my addr 172.21.15.153:0/2647323405 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f9576a00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f958015d160 0x7f95800b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957fe00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 0x7f95800b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 -- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f958015d160 msgr2=0x7f95800b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f958015d160 0x7f95800b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 -- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 msgr2=0x7f95800b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 0x7f95800b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.592+0000 7f957f400640 1 -- 172.21.15.153:0/2647323405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580156000 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f957fe00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 0x7f95800b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f957f400640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f957000c430 tx=0x7f957000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570011790 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9570017070 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95801562e0 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570011ce0 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.593+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95800adc70 con 0x7f9580073db0 2024-09-17T03:15:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.594+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958015d570 con 0x7f9580073db0 2024-09-17T03:15:30.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.595+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f957001c460 con 0x7f9580073db0 2024-09-17T03:15:30.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.596+0000 7f9577e00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 0x7f955c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.597+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f957009acc0 con 0x7f9580073db0 2024-09-17T03:15:30.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.597+0000 7f9576a00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 0x7f955c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.597+0000 7f9576a00640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 0x7f955c07b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95800ca270 tx=0x7f9568009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.601+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9570062f20 con 0x7f9580073db0 2024-09-17T03:15:30.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.796+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95800c4fb0 con 0x7f9580073db0 2024-09-17T03:15:30.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.796+0000 7f9577e00640 1 -- 172.21.15.153:0/2647323405 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v47) ==== 80+0+122 (secure 0 0 0) 0x7f9570062820 con 0x7f9580073db0 2024-09-17T03:15:30.796 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153:6835/402446814 2024-09-18T03:14:52.368725+0000 2024-09-17T03:15:30.796 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153:6833/402446814 2024-09-18T03:14:52.368725+0000 2024-09-17T03:15:30.796 INFO:teuthology.orchestra.run.smithi153.stderr:listed 2 entries 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.798+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 msgr2=0x7f955c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.798+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 0x7f955c07b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95800ca270 tx=0x7f9568009040 comp rx=0 tx=0).stop 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.798+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 msgr2=0x7f958014e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.798+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f957000c430 tx=0x7f957000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 shutdown_connections 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f955c078b90 0x7f955c07b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9580154d30 0x7f95800b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f958015d160 0x7f95800b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 --2- 172.21.15.153:0/2647323405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9580073db0 0x7f958014e7e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 >> 172.21.15.153:0/2647323405 conn(0x7f95800cc910 msgr2=0x7f95800cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 shutdown_connections 2024-09-17T03:15:30.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:30.799+0000 7f9585200640 1 -- 172.21.15.153:0/2647323405 wait complete. 2024-09-17T03:15:30.823 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:15:30.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:30.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:30.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:15:30.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:30.935 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:15:30.986 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:30.986 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:15:30.986 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:31.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:31.023 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:31.024 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:31.024 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:31.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:31.061 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:31.061 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:15:31.061 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:31.099 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:31.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 -- 172.21.15.153:0/4090314744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cc450 msgr2=0x7fbe900d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 --2- 172.21.15.153:0/4090314744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cc450 0x7fbe900d0560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009830 tx=0x7fbe7c02a510 comp rx=0 tx=0).stop 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 -- 172.21.15.153:0/4090314744 shutdown_connections 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 --2- 172.21.15.153:0/4090314744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cc450 0x7fbe900d0560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 --2- 172.21.15.153:0/4090314744 >> v2:172.21.15.164:3300/0 conn(0x7fbe90156e90 0x7fbe900703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 -- 172.21.15.153:0/4090314744 >> 172.21.15.153:0/4090314744 conn(0x7fbe900b34b0 msgr2=0x7fbe900b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 -- 172.21.15.153:0/4090314744 shutdown_connections 2024-09-17T03:15:31.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.323+0000 7fbe96200640 1 -- 172.21.15.153:0/4090314744 wait complete. 2024-09-17T03:15:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.325+0000 7fbe96200640 1 Processor -- start 2024-09-17T03:15:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.325+0000 7fbe96200640 1 -- start start 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe900d0aa0 0x7fbe9015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cf800 0x7fbe9015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900cd3a0 con 0x7fbe900cc450 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900cd220 con 0x7fbe900d0aa0 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe96200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900cd520 con 0x7fbe900cf800 2024-09-17T03:15:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45698/0 (socket says 172.21.15.153:45698) 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 -- 172.21.15.153:0/2447606525 learned_addr learned my addr 172.21.15.153:0/2447606525 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8ea00640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe900d0aa0 0x7fbe9015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8fe00640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cf800 0x7fbe9015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 -- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cf800 msgr2=0x7fbe9015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cf800 0x7fbe9015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 -- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe900d0aa0 msgr2=0x7fbe9015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe900d0aa0 0x7fbe9015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.327+0000 7fbe8f400640 1 -- 172.21.15.153:0/2447606525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe900c92b0 con 0x7fbe900cc450 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe8f400640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9f0 tx=0x7fbe8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000cd80 con 0x7fbe900cc450 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe80004020 con 0x7fbe900cc450 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80004470 con 0x7fbe900cc450 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe900c6a90 con 0x7fbe900cc450 2024-09-17T03:15:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.328+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe901f6680 con 0x7fbe900cc450 2024-09-17T03:15:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.329+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe90156e90 con 0x7fbe900cc450 2024-09-17T03:15:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.330+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe800035f0 con 0x7fbe900cc450 2024-09-17T03:15:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.331+0000 7fbe87400640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 0x7fbe7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.331+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7fbe8009b810 con 0x7fbe900cc450 2024-09-17T03:15:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.332+0000 7fbe8ea00640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 0x7fbe7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.332+0000 7fbe8ea00640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 0x7fbe7007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c034000 tx=0x7fbe7c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.336+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe80063380 con 0x7fbe900cc450 2024-09-17T03:15:31.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.557+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe9006d560 con 0x7fbe900cc450 2024-09-17T03:15:31.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.558+0000 7fbe87400640 1 -- 172.21.15.153:0/2447606525 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7fbe80067db0 con 0x7fbe900cc450 2024-09-17T03:15:31.557 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:31.557 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":25,"btime":"2024-09-17T03:14:56:401155+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:56.401147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-09-17T03:15:31.557 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 25 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.560+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 msgr2=0x7fbe7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.560+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 0x7fbe7007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c034000 tx=0x7fbe7c004730 comp rx=0 tx=0).stop 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 msgr2=0x7fbe901f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9f0 tx=0x7fbe8000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 shutdown_connections 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe70078b90 0x7fbe7007b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe900cf800 0x7fbe9015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe900d0aa0 0x7fbe9015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 --2- 172.21.15.153:0/2447606525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe900cc450 0x7fbe901f2d20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 >> 172.21.15.153:0/2447606525 conn(0x7fbe900b34b0 msgr2=0x7fbe900afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 shutdown_connections 2024-09-17T03:15:31.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.561+0000 7fbe96200640 1 -- 172.21.15.153:0/2447606525 wait complete. 2024-09-17T03:15:31.585 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:31.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 -- 172.21.15.153:0/2470934378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 msgr2=0x7f015c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 --2- 172.21.15.153:0/2470934378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f015c004800 0x7f015c004c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0160009b50 tx=0x7f015c005830 comp rx=0 tx=0).stop 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f0177400640 1 -- 172.21.15.153:0/2470934378 reap_dead start 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 -- 172.21.15.153:0/2470934378 shutdown_connections 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 -- 172.21.15.153:0/2470934378 >> 172.21.15.153:0/2470934378 conn(0x7f01780b34b0 msgr2=0x7f01780b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 -- 172.21.15.153:0/2470934378 shutdown_connections 2024-09-17T03:15:31.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.808+0000 7f017d600640 1 -- 172.21.15.153:0/2470934378 wait complete. 2024-09-17T03:15:31.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.811+0000 7f017d600640 1 Processor -- start 2024-09-17T03:15:31.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.811+0000 7f017d600640 1 -- start start 2024-09-17T03:15:31.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f015c004800 0x7f0178099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f017809d9c0 0x7f0178150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f017815fcc0 con 0x7f01781f5140 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f017815fb40 con 0x7f017809d9c0 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f017d600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f01780d0560 con 0x7f015c004800 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f016e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.812+0000 7f016e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45708/0 (socket says 172.21.15.153:45708) 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 -- 172.21.15.153:0/644810695 learned_addr learned my addr 172.21.15.153:0/644810695 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f0176a00640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f015c004800 0x7f0178099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f0177400640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f017809d9c0 0x7f0178150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 -- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f015c004800 msgr2=0x7f0178099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f015c004800 0x7f0178099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 -- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f017809d9c0 msgr2=0x7f0178150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f017809d9c0 0x7f0178150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 -- 172.21.15.153:0/644810695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017809ddd0 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016e000640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0160036040 tx=0x7f0160033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160043070 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0160004340 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0178099e40 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.813+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160038040 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.814+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781f5ee0 con 0x7f01781f5140 2024-09-17T03:15:31.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.815+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01781f5970 con 0x7f01781f5140 2024-09-17T03:15:31.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.816+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0160046070 con 0x7f01781f5140 2024-09-17T03:15:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.817+0000 7f016f400640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.817+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f01600bb650 con 0x7f01781f5140 2024-09-17T03:15:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.817+0000 7f0176a00640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.818+0000 7f0176a00640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0168001eb0 tx=0x7f0168001110 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:31.821+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f017809ddd0 con 0x7f01781f5140 2024-09-17T03:15:32.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.039+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f017806d400 con 0x7f01781f5140 2024-09-17T03:15:32.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.040+0000 7f016f400640 1 -- 172.21.15.153:0/644810695 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7f0160083130 con 0x7f01781f5140 2024-09-17T03:15:32.039 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:32.039 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":25,"btime":"2024-09-17T03:14:56:401155+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:56.401147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-09-17T03:15:32.040 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 25 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 msgr2=0x7f015407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0168001eb0 tx=0x7f0168001110 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 msgr2=0x7f017809d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0160036040 tx=0x7f0160033670 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 shutdown_connections 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f017809d9c0 0x7f0178150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01781f5140 0x7f017809d480 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.042+0000 7f017d600640 1 --2- 172.21.15.153:0/644810695 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f015c004800 0x7f0178099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.043+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 >> 172.21.15.153:0/644810695 conn(0x7f01780b34b0 msgr2=0x7f01780736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.043+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 shutdown_connections 2024-09-17T03:15:32.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.043+0000 7f017d600640 1 -- 172.21.15.153:0/644810695 wait complete. 2024-09-17T03:15:32.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:32.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 -- 172.21.15.153:0/745959852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96000d0c70 msgr2=0x7f96000703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 --2- 172.21.15.153:0/745959852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96000d0c70 0x7f96000703b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009830 tx=0x7f95e802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 -- 172.21.15.153:0/745959852 shutdown_connections 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 --2- 172.21.15.153:0/745959852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96000d0c70 0x7f96000703b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 -- 172.21.15.153:0/745959852 >> 172.21.15.153:0/745959852 conn(0x7f96000b34b0 msgr2=0x7f96000b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 -- 172.21.15.153:0/745959852 shutdown_connections 2024-09-17T03:15:32.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.287+0000 7f9607c00640 1 -- 172.21.15.153:0/745959852 wait complete. 2024-09-17T03:15:32.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.289+0000 7f9607c00640 1 Processor -- start 2024-09-17T03:15:32.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.290+0000 7f9607c00640 1 -- start start 2024-09-17T03:15:32.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96000cc450 0x7f96000b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9600099830 0x7f9600155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f960006e220 con 0x7f9600150bb0 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f960006e0a0 con 0x7f9600099830 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9607c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f960006e3a0 con 0x7f96000cc450 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9605c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9605c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45726/0 (socket says 172.21.15.153:45726) 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f95f7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9600099830 0x7f9600155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9605c00640 1 -- 172.21.15.153:0/1726165957 learned_addr learned my addr 172.21.15.153:0/1726165957 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:32.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.291+0000 7f9605200640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96000cc450 0x7f96000b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 -- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96000cc450 msgr2=0x7f96000b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96000cc450 0x7f96000b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 -- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9600099830 msgr2=0x7f9600155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9600099830 0x7f9600155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 -- 172.21.15.153:0/1726165957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9600151500 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f9605c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95f800cb10 tx=0x7f95f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.292+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8016020 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.293+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95f800ad60 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.293+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96000b1800 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.293+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8012680 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.293+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9600097460 con 0x7f9600150bb0 2024-09-17T03:15:32.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.294+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9600097250 con 0x7f9600150bb0 2024-09-17T03:15:32.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.295+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95f8019020 con 0x7f9600150bb0 2024-09-17T03:15:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.296+0000 7f95fd600640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 0x7f95dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.296+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f95f809b260 con 0x7f9600150bb0 2024-09-17T03:15:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.297+0000 7f9605200640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 0x7f95dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.297+0000 7f9605200640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 0x7f95dc07b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000f60 tx=0x7f95f0009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.301+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95f8020030 con 0x7f9600150bb0 2024-09-17T03:15:32.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.485+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9600156e90 con 0x7f9600150bb0 2024-09-17T03:15:32.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.487+0000 7f95fd600640 1 -- 172.21.15.153:0/1726165957 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+17341 (secure 0 0 0) 0x7f9600151500 con 0x7f9600150bb0 2024-09-17T03:15:32.486 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:32.486 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":47,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:12.447019+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:35.469865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:36.356142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1","mappings":[{"from":3,"to":5}]},{"pgid":"6.9","mappings":[{"from":4,"to":2}]},{"pgid":"6.a","mappings":[{"from":1,"to":7}]},{"pgid":"6.16","mappings":[{"from":4,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/402446814":"2024-09-18T03:14:52.368725+0000","172.21.15.153:6833/402446814":"2024-09-18T03:14:52.368725+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:32.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 msgr2=0x7f95dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 0x7f95dc07b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000f60 tx=0x7f95f0009040 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 msgr2=0x7f9600150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95f800cb10 tx=0x7f95f800a060 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 shutdown_connections 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f95dc078b90 0x7f95dc07b0a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600150bb0 0x7f9600150fc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9600099830 0x7f9600155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 --2- 172.21.15.153:0/1726165957 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96000cc450 0x7f96000b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 >> 172.21.15.153:0/1726165957 conn(0x7f96000b34b0 msgr2=0x7f96000ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 shutdown_connections 2024-09-17T03:15:32.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.489+0000 7f9607c00640 1 -- 172.21.15.153:0/1726165957 wait complete. 2024-09-17T03:15:32.513 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:15:32.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 -- 172.21.15.153:0/1046891728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61200cc450 msgr2=0x7f612006d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 --2- 172.21.15.153:0/1046891728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61200cc450 0x7f612006d780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6120160120 tx=0x7f611802aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 -- 172.21.15.153:0/1046891728 shutdown_connections 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 --2- 172.21.15.153:0/1046891728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61200cc450 0x7f612006d780 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 --2- 172.21.15.153:0/1046891728 >> v2:172.21.15.164:3300/0 conn(0x7f61200d0c70 0x7f61200703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 -- 172.21.15.153:0/1046891728 >> 172.21.15.153:0/1046891728 conn(0x7f61200b34b0 msgr2=0x7f61200b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 -- 172.21.15.153:0/1046891728 shutdown_connections 2024-09-17T03:15:32.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.736+0000 7f6127600640 1 -- 172.21.15.153:0/1046891728 wait complete. 2024-09-17T03:15:32.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.739+0000 7f6127600640 1 Processor -- start 2024-09-17T03:15:32.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.739+0000 7f6127600640 1 -- start start 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61200cc450 0x7f61200b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 0x7f61200c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f612006e050 con 0x7f61201f8d00 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f612006ded0 con 0x7f61201f68d0 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f6127600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f612006e1d0 con 0x7f61200cc450 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f611fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f611fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45732/0 (socket says 172.21.15.153:45732) 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.740+0000 7f611fe00640 1 -- 172.21.15.153:0/3566387254 learned_addr learned my addr 172.21.15.153:0/3566387254 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f6125600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 0x7f61200c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f6124c00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61200cc450 0x7f61200b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 -- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61200cc450 msgr2=0x7f61200b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61200cc450 0x7f61200b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 -- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 msgr2=0x7f61200c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 0x7f61200c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 -- 172.21.15.153:0/3566387254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61201f6660 con 0x7f61201f8d00 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f6125600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 0x7f61200c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611fe00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d700 tx=0x7f610c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.741+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c017070 con 0x7f61201f8d00 2024-09-17T03:15:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.742+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610c005310 con 0x7f61201f8d00 2024-09-17T03:15:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.742+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c009820 con 0x7f61201f8d00 2024-09-17T03:15:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.742+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61201f96e0 con 0x7f61201f8d00 2024-09-17T03:15:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.742+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61201f5920 con 0x7f61201f8d00 2024-09-17T03:15:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.743+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61201f9450 con 0x7f61201f8d00 2024-09-17T03:15:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.744+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f610c0099c0 con 0x7f61201f8d00 2024-09-17T03:15:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.745+0000 7f611cc00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 0x7f610007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.745+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f610c09b0d0 con 0x7f61201f8d00 2024-09-17T03:15:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.745+0000 7f6124c00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 0x7f610007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.746+0000 7f6124c00640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 0x7f610007b0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.749+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f610c063290 con 0x7f61201f8d00 2024-09-17T03:15:32.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.970+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61201f9c00 con 0x7f61201f8d00 2024-09-17T03:15:32.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.971+0000 7f611cc00640 1 -- 172.21.15.153:0/3566387254 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7f61201f9c00 con 0x7f61201f8d00 2024-09-17T03:15:32.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:32.970 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":25,"btime":"2024-09-17T03:14:56:401155+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:56.401147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-09-17T03:15:32.970 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 25 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 msgr2=0x7f610007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 0x7f610007b0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).stop 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 msgr2=0x7f61201f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f610c00d700 tx=0x7f610c00dbc0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 shutdown_connections 2024-09-17T03:15:32.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6100078bc0 0x7f610007b0d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61201f68d0 0x7f61200c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61201f8d00 0x7f61201f6120 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 --2- 172.21.15.153:0/3566387254 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f61200cc450 0x7f61200b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 >> 172.21.15.153:0/3566387254 conn(0x7f61200b34b0 msgr2=0x7f612015bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 shutdown_connections 2024-09-17T03:15:32.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:32.973+0000 7f6127600640 1 -- 172.21.15.153:0/3566387254 wait complete. 2024-09-17T03:15:32.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:33.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.216+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1246374140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980cc9f0 msgr2=0x7ffb9806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.216+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1246374140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980cc9f0 0x7ffb9806d400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb9806e7f0 tx=0x7ffb8802a530 comp rx=0 tx=0).stop 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1246374140 shutdown_connections 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1246374140 >> v2:172.21.15.164:3300/0 conn(0x7ffb9806d940 0x7ffb980d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1246374140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980cc9f0 0x7ffb9806d400 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1246374140 >> 172.21.15.153:0/1246374140 conn(0x7ffb980b34b0 msgr2=0x7ffb980b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1246374140 shutdown_connections 2024-09-17T03:15:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.217+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1246374140 wait complete. 2024-09-17T03:15:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.219+0000 7ffb9ec00640 1 Processor -- start 2024-09-17T03:15:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.219+0000 7ffb9ec00640 1 -- start start 2024-09-17T03:15:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9806d940 0x7ffb980b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb980cc9f0 0x7ffb9814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb980cc200 con 0x7ffb980d0aa0 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffb980cc080 con 0x7ffb980cc9f0 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.220+0000 7ffb9ec00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9815f730 con 0x7ffb9806d940 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45754/0 (socket says 172.21.15.153:45754) 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 -- 172.21.15.153:0/1754496291 learned_addr learned my addr 172.21.15.153:0/1754496291 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb97e00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9806d940 0x7ffb980b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb8fe00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb980cc9f0 0x7ffb9814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 -- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9806d940 msgr2=0x7ffb980b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9806d940 0x7ffb980b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 -- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb980cc9f0 msgr2=0x7ffb9814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb980cc9f0 0x7ffb9814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 -- 172.21.15.153:0/1754496291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb980afca0 con 0x7ffb980d0aa0 2024-09-17T03:15:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.221+0000 7ffb9cc00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c730 tx=0x7ffb9000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.222+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90003b70 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.222+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb90003d10 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.222+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb900052d0 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.222+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb980aff80 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.222+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb980b0540 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.223+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb980b1500 con 0x7ffb980d0aa0 2024-09-17T03:15:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.224+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb90005470 con 0x7ffb980d0aa0 2024-09-17T03:15:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.225+0000 7ffb94c00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 0x7ffb7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.225+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7ffb9009ac10 con 0x7ffb980d0aa0 2024-09-17T03:15:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.225+0000 7ffb97e00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 0x7ffb7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.226+0000 7ffb97e00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 0x7ffb7407b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb88034000 tx=0x7ffb88004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.229+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb980d0eb0 con 0x7ffb980d0aa0 2024-09-17T03:15:33.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.449+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb98072cc0 con 0x7ffb980d0aa0 2024-09-17T03:15:33.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.449+0000 7ffb94c00640 1 -- 172.21.15.153:0/1754496291 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5218 (secure 0 0 0) 0x7ffb90062780 con 0x7ffb980d0aa0 2024-09-17T03:15:33.449 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:33.449 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":25,"btime":"2024-09-17T03:14:56:401155+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:37.396372+0000","modified":"2024-09-17T03:14:56.401147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.153:6835/3384829696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3384829696},{"type":"v1","addr":"172.21.15.153:6835","nonce":3384829696}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":2}]} 2024-09-17T03:15:33.449 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 25 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 msgr2=0x7ffb7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 0x7ffb7407b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb88034000 tx=0x7ffb88004730 comp rx=0 tx=0).stop 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 msgr2=0x7ffb9809c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c730 tx=0x7ffb9000cb30 comp rx=0 tx=0).stop 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 shutdown_connections 2024-09-17T03:15:33.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffb74078b90 0x7ffb7407b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb980d0aa0 0x7ffb9809c620 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb980cc9f0 0x7ffb9814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 --2- 172.21.15.153:0/1754496291 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffb9806d940 0x7ffb980b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 >> 172.21.15.153:0/1754496291 conn(0x7ffb980b34b0 msgr2=0x7ffb98068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 shutdown_connections 2024-09-17T03:15:33.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.452+0000 7ffb9ec00640 1 -- 172.21.15.153:0/1754496291 wait complete. 2024-09-17T03:15:33.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:33.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 -- 172.21.15.153:0/2243672104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40d1870 msgr2=0x7ff9e40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/2243672104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40d1870 0x7ff9e40b3f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009830 tx=0x7ff9cc02a520 comp rx=0 tx=0).stop 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 -- 172.21.15.153:0/2243672104 shutdown_connections 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/2243672104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40b4470 0x7ff9e40b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/2243672104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40d1870 0x7ff9e40b3f30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 -- 172.21.15.153:0/2243672104 >> 172.21.15.153:0/2243672104 conn(0x7ff9e40ceff0 msgr2=0x7ff9e40cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 -- 172.21.15.153:0/2243672104 shutdown_connections 2024-09-17T03:15:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.697+0000 7ff9e3e00640 1 -- 172.21.15.153:0/2243672104 wait complete. 2024-09-17T03:15:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.699+0000 7ff9e3e00640 1 Processor -- start 2024-09-17T03:15:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.699+0000 7ff9e3e00640 1 -- start start 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9e40cfd20 0x7ff9e4145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40d1870 0x7ff9e40710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40b2430 con 0x7ff9e40b4470 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40b22b0 con 0x7ff9e40cfd20 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e40b25b0 con 0x7ff9e40d1870 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45776/0 (socket says 172.21.15.153:45776) 2024-09-17T03:15:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 -- 172.21.15.153:0/1141854545 learned_addr learned my addr 172.21.15.153:0/1141854545 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e3400640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40d1870 0x7ff9e40710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9da000640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9e40cfd20 0x7ff9e4145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 -- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40d1870 msgr2=0x7ff9e40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40d1870 0x7ff9e40710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 -- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9e40cfd20 msgr2=0x7ff9e4145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9e40cfd20 0x7ff9e4145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.701+0000 7ff9e2a00640 1 -- 172.21.15.153:0/1141854545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e41f94f0 con 0x7ff9e40b4470 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9e2a00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c3a0 tx=0x7ff9d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4011790 con 0x7ff9e40b4470 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d4017070 con 0x7ff9e40b4470 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e41f97d0 con 0x7ff9e40b4470 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4011cc0 con 0x7ff9e40b4470 2024-09-17T03:15:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.702+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41f9d90 con 0x7ff9e40b4470 2024-09-17T03:15:33.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.703+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e40b1ab0 con 0x7ff9e40b4470 2024-09-17T03:15:33.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.704+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9d401c460 con 0x7ff9e40b4470 2024-09-17T03:15:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.705+0000 7ff9db400640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 0x7ff9c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.705+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7ff9d409adc0 con 0x7ff9e40b4470 2024-09-17T03:15:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.706+0000 7ff9da000640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 0x7ff9c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.707+0000 7ff9da000640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 0x7ff9c007b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc034000 tx=0x7ff9cc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.710+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9e40b4880 con 0x7ff9e40b4470 2024-09-17T03:15:33.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.896+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9e41565c0 con 0x7ff9e40b4470 2024-09-17T03:15:33.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.898+0000 7ff9db400640 1 -- 172.21.15.153:0/1141854545 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+17341 (secure 0 0 0) 0x7ff9d4062f80 con 0x7ff9e40b4470 2024-09-17T03:15:33.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:33.897 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":47,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:12.447019+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:35.469865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:36.356142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1","mappings":[{"from":3,"to":5}]},{"pgid":"6.9","mappings":[{"from":4,"to":2}]},{"pgid":"6.a","mappings":[{"from":1,"to":7}]},{"pgid":"6.16","mappings":[{"from":4,"to":2}]},{"pgid":"6.2b","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/402446814":"2024-09-18T03:14:52.368725+0000","172.21.15.153:6833/402446814":"2024-09-18T03:14:52.368725+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 msgr2=0x7ff9c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 0x7ff9c007b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc034000 tx=0x7ff9cc004730 comp rx=0 tx=0).stop 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 msgr2=0x7ff9e41485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c3a0 tx=0x7ff9d400c860 comp rx=0 tx=0).stop 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 shutdown_connections 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ff9c0078b90 0x7ff9c007b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff9e40d1870 0x7ff9e40710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9e40cfd20 0x7ff9e4145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 --2- 172.21.15.153:0/1141854545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e40b4470 0x7ff9e41485d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.900+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 >> 172.21.15.153:0/1141854545 conn(0x7ff9e40ceff0 msgr2=0x7ff9e40d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.901+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 shutdown_connections 2024-09-17T03:15:33.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:33.901+0000 7ff9e3e00640 1 -- 172.21.15.153:0/1141854545 wait complete. 2024-09-17T03:15:33.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:15:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 -- 172.21.15.153:0/585901036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c003a00 msgr2=0x7f563c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 --2- 172.21.15.153:0/585901036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c003a00 0x7f563c003e70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5648009b50 tx=0x7f563c005830 comp rx=0 tx=0).stop 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f5656800640 1 -- 172.21.15.153:0/585901036 reap_dead start 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 -- 172.21.15.153:0/585901036 shutdown_connections 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 -- 172.21.15.153:0/585901036 >> 172.21.15.153:0/585901036 conn(0x7f56580b1c50 msgr2=0x7f56580b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 -- 172.21.15.153:0/585901036 shutdown_connections 2024-09-17T03:15:34.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.147+0000 7f565d200640 1 -- 172.21.15.153:0/585901036 wait complete. 2024-09-17T03:15:34.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.150+0000 7f565d200640 1 Processor -- start 2024-09-17T03:15:34.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.150+0000 7f565d200640 1 -- start start 2024-09-17T03:15:34.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f563c003a00 0x7f56580c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56580b34d0 0x7f565806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f56580caf30 con 0x7f56581f4030 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f56580cadb0 con 0x7f56580b34d0 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f565d200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f56580cb0b0 con 0x7f563c003a00 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f5655400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f5655400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34814/0 (socket says 172.21.15.153:34814) 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.151+0000 7f5655400640 1 -- 172.21.15.153:0/651025026 learned_addr learned my addr 172.21.15.153:0/651025026 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5656800640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56580b34d0 0x7f565806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655e00640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f563c003a00 0x7f56580c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 -- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f563c003a00 msgr2=0x7f56580c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f563c003a00 0x7f56580c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 -- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56580b34d0 msgr2=0x7f565806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56580b34d0 0x7f565806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 -- 172.21.15.153:0/651025026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56580c6780 con 0x7f56581f4030 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f5655400640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f56440118e0 tx=0x7f5644011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564401e070 con 0x7f56581f4030 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f564400f920 con 0x7f56581f4030 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564400fd90 con 0x7f56581f4030 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.152+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56580c6a60 con 0x7f56581f4030 2024-09-17T03:15:34.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.153+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56580b3a60 con 0x7f56581f4030 2024-09-17T03:15:34.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.154+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56581f4440 con 0x7f56581f4030 2024-09-17T03:15:34.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.155+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5644021070 con 0x7f56581f4030 2024-09-17T03:15:34.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.156+0000 7f564e000640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 0x7f563807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.156+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6332+0+0 (secure 0 0 0) 0x7f564409ba10 con 0x7f56581f4030 2024-09-17T03:15:34.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.157+0000 7f5655e00640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 0x7f563807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.158+0000 7f5655e00640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 0x7f563807b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5648009b50 tx=0x7f564802d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.161+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56440634f0 con 0x7f56581f4030 2024-09-17T03:15:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.380+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f56580c6510 con 0x7f56581f4030 2024-09-17T03:15:34.380 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-09-17T03:15:34.381+0000 7f8431a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:15:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.383+0000 7f564e000640 1 -- 172.21.15.153:0/651025026 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f5644067f20 con 0x7f56581f4030 2024-09-17T03:15:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:15:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.386+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 msgr2=0x7f563807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.386+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 0x7f563807b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5648009b50 tx=0x7f564802d040 comp rx=0 tx=0).stop 2024-09-17T03:15:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.386+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 msgr2=0x7f56580b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.386+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f56440118e0 tx=0x7f5644011da0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 shutdown_connections 2024-09-17T03:15:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5638078b90 0x7f563807b0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56580b34d0 0x7f565806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56581f4030 0x7f56580b2f90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 --2- 172.21.15.153:0/651025026 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f563c003a00 0x7f56580c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 >> 172.21.15.153:0/651025026 conn(0x7f56580b1c50 msgr2=0x7f56580ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 shutdown_connections 2024-09-17T03:15:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.387+0000 7f565d200640 1 -- 172.21.15.153:0/651025026 wait complete. 2024-09-17T03:15:34.408 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:15:34.528 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:15:34.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 -- 172.21.15.153:0/3536909238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100706e0 msgr2=0x7f6a100ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 --2- 172.21.15.153:0/3536909238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100706e0 0x7f6a100ca7b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6a100766e0 tx=0x7f6a0802a820 comp rx=0 tx=0).stop 2024-09-17T03:15:34.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 -- 172.21.15.153:0/3536909238 shutdown_connections 2024-09-17T03:15:34.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 --2- 172.21.15.153:0/3536909238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100706e0 0x7f6a100ca7b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 --2- 172.21.15.153:0/3536909238 >> v2:172.21.15.164:3300/0 conn(0x7f6a1006e450 0x7f6a1015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 -- 172.21.15.153:0/3536909238 >> 172.21.15.153:0/3536909238 conn(0x7f6a100b1c50 msgr2=0x7f6a100b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:34.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 -- 172.21.15.153:0/3536909238 shutdown_connections 2024-09-17T03:15:34.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.640+0000 7f6a16800640 1 -- 172.21.15.153:0/3536909238 wait complete. 2024-09-17T03:15:34.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.642+0000 7f6a16800640 1 Processor -- start 2024-09-17T03:15:34.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.642+0000 7f6a16800640 1 -- start start 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a1006ed40 0x7f6a101f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a100706e0 0x7f6a100c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10074710 con 0x7f6a100c44d0 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10074590 con 0x7f6a100706e0 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a16800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6a10074890 con 0x7f6a1006ed40 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34860/0 (socket says 172.21.15.153:34860) 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 -- 172.21.15.153:0/2821006858 learned_addr learned my addr 172.21.15.153:0/2821006858 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0ea00640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a100706e0 0x7f6a100c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0f400640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a1006ed40 0x7f6a101f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 -- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a1006ed40 msgr2=0x7f6a101f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a1006ed40 0x7f6a101f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 -- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a100706e0 msgr2=0x7f6a100c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.644+0000 7f6a0fe00640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a100706e0 0x7f6a100c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a0fe00640 1 -- 172.21.15.153:0/2821006858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1009eda0 con 0x7f6a100c44d0 2024-09-17T03:15:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a0fe00640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009ca0 tx=0x7f6a08032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0803f020 con 0x7f6a100c44d0 2024-09-17T03:15:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a08004040 con 0x7f6a100c44d0 2024-09-17T03:15:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08037040 con 0x7f6a100c44d0 2024-09-17T03:15:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1009f080 con 0x7f6a100c44d0 2024-09-17T03:15:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.645+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1009f640 con 0x7f6a100c44d0 2024-09-17T03:15:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.647+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10074d50 con 0x7f6a100c44d0 2024-09-17T03:15:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.648+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a08042020 con 0x7f6a100c44d0 2024-09-17T03:15:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.649+0000 7f6a07400640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.649+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6418+0+0 (secure 0 0 0) 0x7f6a080bb7d0 con 0x7f6a100c44d0 2024-09-17T03:15:34.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.649+0000 7f6a0f400640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.650+0000 7f6a0f400640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 0x7f69f007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6a00001720 tx=0x7f6a00007e90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.653+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a08049020 con 0x7f6a100c44d0 2024-09-17T03:15:34.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:34.875+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6a1015cb70 con 0x7f6a100c44d0 2024-09-17T03:15:35.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.522+0000 7f6a07400640 1 -- 172.21.15.153:0/2821006858 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f6a08083410 con 0x7f6a100c44d0 2024-09-17T03:15:35.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 msgr2=0x7f69f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 0x7f69f007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6a00001720 tx=0x7f6a00007e90 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 msgr2=0x7f6a10158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009ca0 tx=0x7f6a08032c90 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 shutdown_connections 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a100c44d0 0x7f6a10158030 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a100706e0 0x7f6a100c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 --2- 172.21.15.153:0/2821006858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6a1006ed40 0x7f6a101f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 >> 172.21.15.153:0/2821006858 conn(0x7f6a100b1c50 msgr2=0x7f6a1015b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 shutdown_connections 2024-09-17T03:15:35.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.525+0000 7f6a16800640 1 -- 172.21.15.153:0/2821006858 wait complete. 2024-09-17T03:15:35.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:15:35.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 -- 172.21.15.153:0/2907282680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cc7d0 msgr2=0x7fec9415ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 --2- 172.21.15.153:0/2907282680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cc7d0 0x7fec9415ffc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009830 tx=0x7fec7c02a470 comp rx=0 tx=0).stop 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 -- 172.21.15.153:0/2907282680 shutdown_connections 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 --2- 172.21.15.153:0/2907282680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cc7d0 0x7fec9415ffc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 --2- 172.21.15.153:0/2907282680 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec940cfa50 0x7fec940b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 -- 172.21.15.153:0/2907282680 >> 172.21.15.153:0/2907282680 conn(0x7fec940b1be0 msgr2=0x7fec940b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 -- 172.21.15.153:0/2907282680 shutdown_connections 2024-09-17T03:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.776+0000 7fec93200640 1 -- 172.21.15.153:0/2907282680 wait complete. 2024-09-17T03:15:35.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.779+0000 7fec93200640 1 Processor -- start 2024-09-17T03:15:35.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.779+0000 7fec93200640 1 -- start start 2024-09-17T03:15:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec940cc7d0 0x7fec94072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 0x7fec941f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415d0e0 con 0x7fec940cfa50 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fec9406e5a0 con 0x7fec940cc7d0 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.780+0000 7fec93200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fec9415d260 con 0x7fec94160500 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34880/0 (socket says 172.21.15.153:34880) 2024-09-17T03:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 -- 172.21.15.153:0/837801890 learned_addr learned my addr 172.21.15.153:0/837801890 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec91e00640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec940cc7d0 0x7fec94072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec92800640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 0x7fec941f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 -- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 msgr2=0x7fec941f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 0x7fec941f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 -- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec940cc7d0 msgr2=0x7fec94072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec940cc7d0 0x7fec94072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 -- 172.21.15.153:0/837801890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941f5370 con 0x7fec940cfa50 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec92800640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 0x7fec941f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.781+0000 7fec89400640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec7c000c00 tx=0x7fec7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.782+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c031d60 con 0x7fec940cfa50 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.782+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec7c033e10 con 0x7fec940cfa50 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.782+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec940a95d0 con 0x7fec940cfa50 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.782+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c033310 con 0x7fec940cfa50 2024-09-17T03:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.782+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec941f5610 con 0x7fec940cfa50 2024-09-17T03:15:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.783+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9415d780 con 0x7fec940cfa50 2024-09-17T03:15:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.784+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec7c0334b0 con 0x7fec940cfa50 2024-09-17T03:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.786+0000 7fec8aa00640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 0x7fec7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.786+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6418+0+0 (secure 0 0 0) 0x7fec7c0bc530 con 0x7fec940cfa50 2024-09-17T03:15:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.786+0000 7fec91e00640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 0x7fec7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.787+0000 7fec91e00640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 0x7fec7007b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ac0 tx=0x7fec84005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.791+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec7c03f030 con 0x7fec940cfa50 2024-09-17T03:15:35.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:35.977+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec94160180 con 0x7fec940cfa50 2024-09-17T03:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.524+0000 7fec8aa00640 1 -- 172.21.15.153:0/837801890 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fec7c084690 con 0x7fec940cfa50 2024-09-17T03:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:15:36.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 msgr2=0x7fec7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 0x7fec7007b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ac0 tx=0x7fec84005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:36.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 msgr2=0x7fec940b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec7c000c00 tx=0x7fec7c033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 shutdown_connections 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec70078bc0 0x7fec7007b0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec94160500 0x7fec941f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec940cfa50 0x7fec940b0e20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 --2- 172.21.15.153:0/837801890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec940cc7d0 0x7fec94072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 >> 172.21.15.153:0/837801890 conn(0x7fec940b1be0 msgr2=0x7fec940d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 shutdown_connections 2024-09-17T03:15:36.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.527+0000 7fec93200640 1 -- 172.21.15.153:0/837801890 wait complete. 2024-09-17T03:15:36.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:15:36.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 -- 172.21.15.153:0/4113941167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c15f090 msgr2=0x7fbf5c15f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 --2- 172.21.15.153:0/4113941167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c15f090 0x7fbf5c15f4a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005fd0 tx=0x7fbf5402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 -- 172.21.15.153:0/4113941167 shutdown_connections 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 --2- 172.21.15.153:0/4113941167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c15f090 0x7fbf5c15f4a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 -- 172.21.15.153:0/4113941167 >> 172.21.15.153:0/4113941167 conn(0x7fbf5c0b1c20 msgr2=0x7fbf5c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 -- 172.21.15.153:0/4113941167 shutdown_connections 2024-09-17T03:15:36.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.783+0000 7fbf61200640 1 -- 172.21.15.153:0/4113941167 wait complete. 2024-09-17T03:15:36.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.786+0000 7fbf61200640 1 Processor -- start 2024-09-17T03:15:36.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.786+0000 7fbf61200640 1 -- start start 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c06dc60 0x7fbf5c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf5c15f090 0x7fbf5c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c15f9e0 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c0ae200 con 0x7fbf5c06dc60 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf61200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c15fb60 con 0x7fbf5c15f090 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf51400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf51400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34900/0 (socket says 172.21.15.153:34900) 2024-09-17T03:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf51400640 1 -- 172.21.15.153:0/1392355736 learned_addr learned my addr 172.21.15.153:0/1392355736 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.787+0000 7fbf59e00640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c06dc60 0x7fbf5c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf5a800640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf5c15f090 0x7fbf5c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 -- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf5c15f090 msgr2=0x7fbf5c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf5c15f090 0x7fbf5c150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 -- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c06dc60 msgr2=0x7fbf5c0c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c06dc60 0x7fbf5c0c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 -- 172.21.15.153:0/1392355736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c15bfd0 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf51400640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400b420 tx=0x7fbf4400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011830 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf44016070 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.788+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c14fc90 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.789+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011d60 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.789+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c150250 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.790+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c15f4a0 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.791+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf4401b460 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.792+0000 7fbf52a00640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.792+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5980+0+0 (secure 0 0 0) 0x7fbf4409a7b0 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.792+0000 7fbf59e00640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.793+0000 7fbf59e00640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 0x7fbf3807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c000f60 tx=0x7fbf4c009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.796+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf44020020 con 0x7fbf5c0cdd00 2024-09-17T03:15:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:36.980+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf5c0ca890 con 0x7fbf5c0cdd00 2024-09-17T03:15:37.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.542+0000 7fbf52a00640 1 -- 172.21.15.153:0/1392355736 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7fbf5c15bfd0 con 0x7fbf5c0cdd00 2024-09-17T03:15:37.541 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.544+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 msgr2=0x7fbf3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.544+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 0x7fbf3807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c000f60 tx=0x7fbf4c009040 comp rx=0 tx=0).stop 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.544+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 msgr2=0x7fbf5c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.544+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400b420 tx=0x7fbf4400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 shutdown_connections 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf5c15f090 0x7fbf5c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf5c0cdd00 0x7fbf5c14f300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 --2- 172.21.15.153:0/1392355736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c06dc60 0x7fbf5c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 >> 172.21.15.153:0/1392355736 conn(0x7fbf5c0b1c20 msgr2=0x7fbf5c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 shutdown_connections 2024-09-17T03:15:37.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.545+0000 7fbf61200640 1 -- 172.21.15.153:0/1392355736 wait complete. 2024-09-17T03:15:37.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:15:37.575 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:15:37.669 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T03:15:37.669 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T03:15:37.669 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:15:37.669 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.670 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T03:15:37.671 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-17T03:15:37.672 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T03:15:37.673 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T03:15:37.674 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:37.675 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:37.676 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T03:15:37.677 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T03:15:37.678 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T03:15:37.679 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:15:37.680 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:15:37.681 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T03:15:37.682 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.683 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.684 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:15:37.685 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T03:15:37.686 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:15:37.687 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:15:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:15:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-09-17T03:15:37.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:15:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 -- 172.21.15.153:0/1391176253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda006f690 msgr2=0x7fcda015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 --2- 172.21.15.153:0/1391176253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda006f690 0x7fcda015bb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcda00c36e0 tx=0x7fcd9802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 -- 172.21.15.153:0/1391176253 shutdown_connections 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 --2- 172.21.15.153:0/1391176253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda006f690 0x7fcda015bb40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 --2- 172.21.15.153:0/1391176253 >> v2:172.21.15.164:3300/0 conn(0x7fcda00ae5a0 0x7fcda006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 -- 172.21.15.153:0/1391176253 >> 172.21.15.153:0/1391176253 conn(0x7fcda00b19c0 msgr2=0x7fcda00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 -- 172.21.15.153:0/1391176253 shutdown_connections 2024-09-17T03:15:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.937+0000 7fcda4a00640 1 -- 172.21.15.153:0/1391176253 wait complete. 2024-09-17T03:15:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.939+0000 7fcda4a00640 1 Processor -- start 2024-09-17T03:15:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.939+0000 7fcda4a00640 1 -- start start 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcda006f690 0x7fcda015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcda00cbe90 0x7fcda01579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcda015c200 con 0x7fcda00ae5a0 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcda015c080 con 0x7fcda006f690 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcda4a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcda015c380 con 0x7fcda00cbe90 2024-09-17T03:15:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcd96a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcd96a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34922/0 (socket says 172.21.15.153:34922) 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcd96a00640 1 -- 172.21.15.153:0/2887317816 learned_addr learned my addr 172.21.15.153:0/2887317816 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcd9f400640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcda006f690 0x7fcda015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.941+0000 7fcd9fe00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcda00cbe90 0x7fcda01579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 -- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcda00cbe90 msgr2=0x7fcda01579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcda00cbe90 0x7fcda01579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 -- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcda006f690 msgr2=0x7fcda015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcda006f690 0x7fcda015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 -- 172.21.15.153:0/2887317816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda014e870 con 0x7fcda00ae5a0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd96a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e7c0 tx=0x7fcd8800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800ccc0 con 0x7fcda00ae5a0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd88010430 con 0x7fcda00ae5a0 2024-09-17T03:15:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda0155f30 con 0x7fcda00ae5a0 2024-09-17T03:15:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88010860 con 0x7fcda00ae5a0 2024-09-17T03:15:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.942+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda0158750 con 0x7fcda00ae5a0 2024-09-17T03:15:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.943+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda015bb40 con 0x7fcda00ae5a0 2024-09-17T03:15:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.944+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd88010a00 con 0x7fcda00ae5a0 2024-09-17T03:15:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.945+0000 7fcd97e00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 0x7fcd7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.945+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7fcd8809b590 con 0x7fcda00ae5a0 2024-09-17T03:15:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.946+0000 7fcd9f400640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 0x7fcd7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.946+0000 7fcd9f400640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 0x7fcd7c07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007fd0 tx=0x7fcd90001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:37.950+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd88063490 con 0x7fcda00ae5a0 2024-09-17T03:15:38.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.134+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fcda0160c10 con 0x7fcda00ae5a0 2024-09-17T03:15:38.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.139+0000 7fcd97e00640 1 -- 172.21.15.153:0/2887317816 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fcd8806c020 con 0x7fcda00ae5a0 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 msgr2=0x7fcd7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 0x7fcd7c07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007fd0 tx=0x7fcd90001370 comp rx=0 tx=0).stop 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 msgr2=0x7fcda014e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e7c0 tx=0x7fcd8800ec80 comp rx=0 tx=0).stop 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 shutdown_connections 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcd7c078b90 0x7fcd7c07b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcda00cbe90 0x7fcda01579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda00ae5a0 0x7fcda014e330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 --2- 172.21.15.153:0/2887317816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcda006f690 0x7fcda015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 >> 172.21.15.153:0/2887317816 conn(0x7fcda00b19c0 msgr2=0x7fcda00acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 shutdown_connections 2024-09-17T03:15:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.142+0000 7fcda4a00640 1 -- 172.21.15.153:0/2887317816 wait complete. 2024-09-17T03:15:38.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-09-17T03:15:38.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 -- 172.21.15.153:0/31079785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4190070cf0 msgr2=0x7f419015f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 --2- 172.21.15.153:0/31079785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4190070cf0 0x7f419015f000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f417c005fd0 tx=0x7f417c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 -- 172.21.15.153:0/31079785 shutdown_connections 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 --2- 172.21.15.153:0/31079785 >> v2:172.21.15.164:3300/0 conn(0x7f419015f540 0x7f4190151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 --2- 172.21.15.153:0/31079785 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4190070cf0 0x7f419015f000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 -- 172.21.15.153:0/31079785 >> 172.21.15.153:0/31079785 conn(0x7f41900d0070 msgr2=0x7f41900d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 -- 172.21.15.153:0/31079785 shutdown_connections 2024-09-17T03:15:38.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.391+0000 7f4196400640 1 -- 172.21.15.153:0/31079785 wait complete. 2024-09-17T03:15:38.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.393+0000 7f4196400640 1 Processor -- start 2024-09-17T03:15:38.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.393+0000 7f4196400640 1 -- start start 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f419015f540 0x7f4190158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 0x7f41900b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4190152510 con 0x7f41900cbf40 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4190152390 con 0x7f419015f540 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f4196400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4190152690 con 0x7f41900b53a0 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f418f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f418f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34924/0 (socket says 172.21.15.153:34924) 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f418f400640 1 -- 172.21.15.153:0/291645831 learned_addr learned my addr 172.21.15.153:0/291645831 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f418fe00640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 0x7f41900b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.395+0000 7f418ea00640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f419015f540 0x7f4190158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 -- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 msgr2=0x7f41900b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 0x7f41900b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 -- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f419015f540 msgr2=0x7f4190158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f419015f540 0x7f4190158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 -- 172.21.15.153:0/291645831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41900b5cf0 con 0x7f41900cbf40 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418fe00640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 0x7f41900b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:15:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f418f400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f418000c430 tx=0x7f418000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180017070 con 0x7f41900cbf40 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41800053e0 con 0x7f41900cbf40 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4190158fb0 con 0x7f41900cbf40 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180003850 con 0x7f41900cbf40 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.396+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901f32f0 con 0x7f41900cbf40 2024-09-17T03:15:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.397+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41900aeec0 con 0x7f41900cbf40 2024-09-17T03:15:38.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.399+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f418001a070 con 0x7f41900cbf40 2024-09-17T03:15:38.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.400+0000 7f4187400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 0x7f417007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.400+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f4180099fb0 con 0x7f41900cbf40 2024-09-17T03:15:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.400+0000 7f418ea00640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 0x7f417007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.401+0000 7f418ea00640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 0x7f417007b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f417c033000 tx=0x7f417c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.404+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41900b5cf0 con 0x7f41900cbf40 2024-09-17T03:15:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:38.659+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) -- 0x7f419015f000 con 0x7f41900cbf40 2024-09-17T03:15:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.550+0000 7f4187400640 1 -- 172.21.15.153:0/291645831 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v129) ==== 147+0+0 (secure 0 0 0) 0x7f4180061eb0 con 0x7f41900cbf40 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.553+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 msgr2=0x7f417007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.553+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 0x7f417007b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f417c033000 tx=0x7f417c004730 comp rx=0 tx=0).stop 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 msgr2=0x7f41900ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f418000c430 tx=0x7f418000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 shutdown_connections 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4170078b90 0x7f417007b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41900b53a0 0x7f41900b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f419015f540 0x7f4190158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 --2- 172.21.15.153:0/291645831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41900cbf40 0x7f41900ae980 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 >> 172.21.15.153:0/291645831 conn(0x7f41900d0070 msgr2=0x7f41900ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 shutdown_connections 2024-09-17T03:15:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.554+0000 7f4196400640 1 -- 172.21.15.153:0/291645831 wait complete. 2024-09-17T03:15:39.581 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ok 2024-09-17T03:15:39.581 INFO:tasks.cephfs_test_runner:Starting test: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) Opening a file should increment omap_total_updates by 1. 2024-09-17T03:15:39.581 INFO:tasks.cephfs_test_runner:test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-09-17T03:15:39.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 -- 172.21.15.153:0/3877369767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 msgr2=0x7fdeb4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3877369767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c4a0 tx=0x7fdeb4005830 comp rx=0 tx=0).stop 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecf400640 1 -- 172.21.15.153:0/3877369767 reap_dead start 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 -- 172.21.15.153:0/3877369767 shutdown_connections 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 -- 172.21.15.153:0/3877369767 >> 172.21.15.153:0/3877369767 conn(0x7fded00cf330 msgr2=0x7fded00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 -- 172.21.15.153:0/3877369767 shutdown_connections 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.808+0000 7fdecfe00640 1 -- 172.21.15.153:0/3877369767 wait complete. 2024-09-17T03:15:39.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.810+0000 7fdecfe00640 1 Processor -- start 2024-09-17T03:15:39.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.811+0000 7fdecfe00640 1 -- start start 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fded015b540 0x7fded01f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fded01f5560 0x7fded01f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fded0073130 con 0x7fdeb4004800 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fded0072fb0 con 0x7fded015b540 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecfe00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fded006e610 con 0x7fded01f5560 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34936/0 (socket says 172.21.15.153:34936) 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.812+0000 7fdecea00640 1 -- 172.21.15.153:0/3858704715 learned_addr learned my addr 172.21.15.153:0/3858704715 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdec6000640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fded015b540 0x7fded01f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecf400640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fded01f5560 0x7fded01f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 -- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fded01f5560 msgr2=0x7fded01f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fded01f5560 0x7fded01f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 -- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fded015b540 msgr2=0x7fded01f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fded015b540 0x7fded01f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 -- 172.21.15.153:0/3858704715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded0161650 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecea00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdec0003e90 tx=0x7fdec0001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0015070 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdec0011860 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded01608b0 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0011cb0 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.813+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded0160e50 con 0x7fdeb4004800 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.815+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded00728a0 con 0x7fdeb4004800 2024-09-17T03:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.816+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdec0018070 con 0x7fdeb4004800 2024-09-17T03:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.817+0000 7fdec7e00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 0x7fdeac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.817+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7fdec009ba30 con 0x7fdeb4004800 2024-09-17T03:15:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.817+0000 7fdec6000640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 0x7fdeac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.818+0000 7fdec6000640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 0x7fdeac07b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c470 tx=0x7fdeb8001bc0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:39.822+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdec0063f80 con 0x7fdeb4004800 2024-09-17T03:15:40.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.004+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fded00ce1c0 con 0x7fdeb4004800 2024-09-17T03:15:40.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.005+0000 7fdec7e00640 1 -- 172.21.15.153:0/3858704715 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13473 (secure 0 0 0) 0x7fdec0063880 con 0x7fdeb4004800 2024-09-17T03:15:40.004 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:40.005 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:37.536035+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/3384829696":"2024-09-18T03:15:34.382151+0000","172.21.15.153:6835/402446814":"2024-09-18T03:14:52.368725+0000","172.21.15.153:6835/3384829696":"2024-09-18T03:15:34.382151+0000","172.21.15.153:6833/402446814":"2024-09-18T03:14:52.368725+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.007+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 msgr2=0x7fdeac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 0x7fdeac07b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c470 tx=0x7fdeb8001bc0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 msgr2=0x7fded0160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdec0003e90 tx=0x7fdec0001780 comp rx=0 tx=0).stop 2024-09-17T03:15:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 shutdown_connections 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdeac078b90 0x7fdeac07b0a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fded01f5560 0x7fded01f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fded015b540 0x7fded01f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 --2- 172.21.15.153:0/3858704715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdeb4004800 0x7fded0160130 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 >> 172.21.15.153:0/3858704715 conn(0x7fded00cf330 msgr2=0x7fded00cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 shutdown_connections 2024-09-17T03:15:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.008+0000 7fdecfe00640 1 -- 172.21.15.153:0/3858704715 wait complete. 2024-09-17T03:15:40.030 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:13:22.848530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:15:40.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 -- 172.21.15.153:0/1679492815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b8070530 msgr2=0x7f69b80ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 --2- 172.21.15.153:0/1679492815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b8070530 0x7f69b80ca6b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f69a8005fd0 tx=0x7f69a802a540 comp rx=0 tx=0).stop 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 -- 172.21.15.153:0/1679492815 shutdown_connections 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 --2- 172.21.15.153:0/1679492815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cca70 0x7f69b80cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 --2- 172.21.15.153:0/1679492815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b8070530 0x7f69b80ca6b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.254+0000 7f69bd000640 1 -- 172.21.15.153:0/1679492815 >> 172.21.15.153:0/1679492815 conn(0x7f69b80b1df0 msgr2=0x7f69b80b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.255+0000 7f69bd000640 1 -- 172.21.15.153:0/1679492815 shutdown_connections 2024-09-17T03:15:40.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.255+0000 7f69bd000640 1 -- 172.21.15.153:0/1679492815 wait complete. 2024-09-17T03:15:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.257+0000 7f69bd000640 1 Processor -- start 2024-09-17T03:15:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.257+0000 7f69bd000640 1 -- start start 2024-09-17T03:15:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69b8070530 0x7f69b81f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cb450 0x7f69b81d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69b806f3e0 con 0x7f69b80cca70 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f69b806f260 con 0x7f69b8070530 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.258+0000 7f69bd000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f69b806f560 con 0x7f69b80cb450 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34964/0 (socket says 172.21.15.153:34964) 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b5e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69b8070530 0x7f69b81f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 -- 172.21.15.153:0/195652278 learned_addr learned my addr 172.21.15.153:0/195652278 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b5400640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cb450 0x7f69b81d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 -- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cb450 msgr2=0x7f69b81d67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cb450 0x7f69b81d67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 -- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69b8070530 msgr2=0x7f69b81f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69b8070530 0x7f69b81f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.259+0000 7f69b6800640 1 -- 172.21.15.153:0/195652278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b81f7210 con 0x7f69b80cca70 2024-09-17T03:15:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69b6800640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69b000e960 tx=0x7f69b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0004d20 con 0x7f69b80cca70 2024-09-17T03:15:40.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69b000cb20 con 0x7f69b80cca70 2024-09-17T03:15:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0005020 con 0x7f69b80cca70 2024-09-17T03:15:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b81f74f0 con 0x7f69b80cca70 2024-09-17T03:15:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.260+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b81d0f10 con 0x7f69b80cca70 2024-09-17T03:15:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.261+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b81f7730 con 0x7f69b80cca70 2024-09-17T03:15:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.262+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69b00051c0 con 0x7f69b80cca70 2024-09-17T03:15:40.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.264+0000 7f69ae000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.264+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f69b009b440 con 0x7f69b80cca70 2024-09-17T03:15:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.264+0000 7f69b5e00640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.265+0000 7f69b5e00640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 0x7f699807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69a8033000 tx=0x7f69a8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.269+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69b81f7730 con 0x7f69b80cca70 2024-09-17T03:15:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.453+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f69b81f6f80 con 0x7f69b80cca70 2024-09-17T03:15:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.453+0000 7f69ae000640 1 -- 172.21.15.153:0/195652278 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f69b0016030 con 0x7f69b80cca70 2024-09-17T03:15:40.453 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2024-09-17T03:15:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 msgr2=0x7f699807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 0x7f699807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69a8033000 tx=0x7f69a8004730 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 msgr2=0x7f69b81d6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69b000e960 tx=0x7f69b000ee20 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 shutdown_connections 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69b80cca70 0x7f69b81d6cf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69b80cb450 0x7f69b81d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 --2- 172.21.15.153:0/195652278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f69b8070530 0x7f69b81f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 >> 172.21.15.153:0/195652278 conn(0x7f69b80b1df0 msgr2=0x7f69b80b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 shutdown_connections 2024-09-17T03:15:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.456+0000 7f69bd000640 1 -- 172.21.15.153:0/195652278 wait complete. 2024-09-17T03:15:40.478 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-09-17T03:15:40.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.701+0000 7f5d34a00640 1 -- 172.21.15.153:0/3204452398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d140053a0 msgr2=0x7f5d1400ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.701+0000 7f5d34a00640 1 --2- 172.21.15.153:0/3204452398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d140053a0 0x7f5d1400ba20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d14005830 comp rx=0 tx=0).stop 2024-09-17T03:15:40.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.702+0000 7f5d34a00640 1 -- 172.21.15.153:0/3204452398 shutdown_connections 2024-09-17T03:15:40.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.702+0000 7f5d34a00640 1 --2- 172.21.15.153:0/3204452398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d140053a0 0x7f5d1400ba20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.702+0000 7f5d34a00640 1 -- 172.21.15.153:0/3204452398 >> 172.21.15.153:0/3204452398 conn(0x7f5d3006d1b0 msgr2=0x7f5d3006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.702+0000 7f5d34a00640 1 -- 172.21.15.153:0/3204452398 shutdown_connections 2024-09-17T03:15:40.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.702+0000 7f5d34a00640 1 -- 172.21.15.153:0/3204452398 wait complete. 2024-09-17T03:15:40.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.704+0000 7f5d34a00640 1 Processor -- start 2024-09-17T03:15:40.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.704+0000 7f5d34a00640 1 -- start start 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.705+0000 7f5d34a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d140053a0 0x7f5d3014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.705+0000 7f5d34a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d34a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 0x7f5d300caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d34a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3015d600 con 0x7f5d3006e8b0 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d34a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301608c0 con 0x7f5d140053a0 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d34a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3015d780 con 0x7f5d300ca3c0 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34986/0 (socket says 172.21.15.153:34986) 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 -- 172.21.15.153:0/794981331 learned_addr learned my addr 172.21.15.153:0/794981331 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2de00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d140053a0 0x7f5d3014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2e800640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 0x7f5d300caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 -- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 msgr2=0x7f5d300caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 0x7f5d300caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 -- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d140053a0 msgr2=0x7f5d3014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d140053a0 0x7f5d3014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2d400640 1 -- 172.21.15.153:0/794981331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3006ee50 con 0x7f5d3006e8b0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.706+0000 7f5d2e800640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 0x7f5d300caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d2d400640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c003ea0 tx=0x7f5d1c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c015070 con 0x7f5d3006e8b0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d1c011840 con 0x7f5d3006e8b0 2024-09-17T03:15:40.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3006f130 con 0x7f5d3006e8b0 2024-09-17T03:15:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011c50 con 0x7f5d3006e8b0 2024-09-17T03:15:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.707+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3006f6f0 con 0x7f5d3006e8b0 2024-09-17T03:15:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.708+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d300cfa60 con 0x7f5d3006e8b0 2024-09-17T03:15:40.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.709+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d1c018070 con 0x7f5d3006e8b0 2024-09-17T03:15:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.710+0000 7f5d26000640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 0x7f5d1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.711+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f5d1c09b950 con 0x7f5d3006e8b0 2024-09-17T03:15:40.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.711+0000 7f5d2de00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 0x7f5d1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.712+0000 7f5d2de00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 0x7f5d1007b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009b10 tx=0x7f5d20005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.715+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d1c063e10 con 0x7f5d3006e8b0 2024-09-17T03:15:40.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:40.972+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) -- 0x7f5d3015c7e0 con 0x7f5d3006e8b0 2024-09-17T03:15:41.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.558+0000 7f5d26000640 1 -- 172.21.15.153:0/794981331 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v131) ==== 146+0+0 (secure 0 0 0) 0x7f5d1c063710 con 0x7f5d3006e8b0 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 msgr2=0x7f5d1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 0x7f5d1007b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009b10 tx=0x7f5d20005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 msgr2=0x7f5d300ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c003ea0 tx=0x7f5d1c003f90 comp rx=0 tx=0).stop 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 shutdown_connections 2024-09-17T03:15:41.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5d10078b90 0x7f5d1007b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d300ca3c0 0x7f5d300caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3006e8b0 0x7f5d300ca9a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 --2- 172.21.15.153:0/794981331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d140053a0 0x7f5d3014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.561+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 >> 172.21.15.153:0/794981331 conn(0x7f5d3006d1b0 msgr2=0x7f5d3015b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.562+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 shutdown_connections 2024-09-17T03:15:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.562+0000 7f5d34a00640 1 -- 172.21.15.153:0/794981331 wait complete. 2024-09-17T03:15:41.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:15:41.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.809+0000 7f6b2c000640 1 -- 172.21.15.153:0/4289415671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 msgr2=0x7f6b24072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.809+0000 7f6b2c000640 1 --2- 172.21.15.153:0/4289415671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b24072fa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005fd0 tx=0x7f6b1c02a840 comp rx=0 tx=0).stop 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 -- 172.21.15.153:0/4289415671 shutdown_connections 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 --2- 172.21.15.153:0/4289415671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b24072fa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 --2- 172.21.15.153:0/4289415671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b240cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 -- 172.21.15.153:0/4289415671 >> 172.21.15.153:0/4289415671 conn(0x7f6b240d0070 msgr2=0x7f6b240d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 -- 172.21.15.153:0/4289415671 shutdown_connections 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.810+0000 7f6b2c000640 1 -- 172.21.15.153:0/4289415671 wait complete. 2024-09-17T03:15:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.812+0000 7f6b2c000640 1 Processor -- start 2024-09-17T03:15:41.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.812+0000 7f6b2c000640 1 -- start start 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.813+0000 7f6b2c000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b2406f650 0x7f6b241670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2c000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2c000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b24159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2c000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240734e0 con 0x7f6b24070170 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2c000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240710a0 con 0x7f6b2406f650 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2c000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6b24073660 con 0x7f6b240cddf0 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35000/0 (socket says 172.21.15.153:35000) 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 -- 172.21.15.153:0/3919463438 learned_addr learned my addr 172.21.15.153:0/3919463438 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b29600640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b2406f650 0x7f6b241670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2a000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b24159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 -- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 msgr2=0x7f6b24159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b24159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 -- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b2406f650 msgr2=0x7f6b241670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b2406f650 0x7f6b241670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b28c00640 1 -- 172.21.15.153:0/3919463438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b241f5880 con 0x7f6b24070170 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.814+0000 7f6b2a000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b24159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b28c00640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c3c0 tx=0x7f6b1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10017070 con 0x7f6b24070170 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b100035f0 con 0x7f6b24070170 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b241f5b00 con 0x7f6b24070170 2024-09-17T03:15:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10003a60 con 0x7f6b24070170 2024-09-17T03:15:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.815+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b241f60c0 con 0x7f6b24070170 2024-09-17T03:15:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.816+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b240cb7f0 con 0x7f6b24070170 2024-09-17T03:15:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.817+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b1001a070 con 0x7f6b24070170 2024-09-17T03:15:41.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.818+0000 7f6b21600640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 0x7f6b0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.818+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f6b10099db0 con 0x7f6b24070170 2024-09-17T03:15:41.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.819+0000 7f6b29600640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 0x7f6b0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.820+0000 7f6b29600640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 0x7f6b0407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098e0 tx=0x7f6b18009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:41.823+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b240cb7f0 con 0x7f6b24070170 2024-09-17T03:15:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.007+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6b24072fa0 con 0x7f6b24070170 2024-09-17T03:15:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.007+0000 7f6b21600640 1 -- 172.21.15.153:0/3919463438 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7f6b1009e070 con 0x7f6b24070170 2024-09-17T03:15:42.006 INFO:teuthology.orchestra.run.smithi153.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_client 20/20 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3069.500150 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4708.762151 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3081.880144 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3108.202497 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4146.914538 2024-09-17T03:15:42.007 INFO:teuthology.orchestra.run.smithi153.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4162.753164 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7325.320731 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4012.872074 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds 20/20 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced debug_ms 2/2 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_frag true 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds dev mds_verify_scatter true 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:15:42.008 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced client_mount_timeout 600 2024-09-17T03:15:42.009 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_client 20/20 2024-09-17T03:15:42.009 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced debug_ms 1/1 2024-09-17T03:15:42.009 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:15:42.009 INFO:teuthology.orchestra.run.smithi153.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 msgr2=0x7f6b0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 0x7f6b0407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098e0 tx=0x7f6b18009060 comp rx=0 tx=0).stop 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 msgr2=0x7f6b2415a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c3c0 tx=0x7f6b1000c880 comp rx=0 tx=0).stop 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 shutdown_connections 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6b04078b90 0x7f6b0407b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6b240cddf0 0x7f6b24159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b24070170 0x7f6b2415a2b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 --2- 172.21.15.153:0/3919463438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b2406f650 0x7f6b241670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 >> 172.21.15.153:0/3919463438 conn(0x7f6b240d0070 msgr2=0x7f6b2406fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 shutdown_connections 2024-09-17T03:15:42.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.010+0000 7f6b2c000640 1 -- 172.21.15.153:0/3919463438 wait complete. 2024-09-17T03:15:42.032 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:15:42.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 -- 172.21.15.153:0/801454434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 msgr2=0x7f5be80745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 --2- 172.21.15.153:0/801454434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be80745c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5be8076330 tx=0x7f5bd002a440 comp rx=0 tx=0).stop 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 -- 172.21.15.153:0/801454434 shutdown_connections 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 --2- 172.21.15.153:0/801454434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be80745c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 --2- 172.21.15.153:0/801454434 >> v2:172.21.15.164:3300/0 conn(0x7f5be815b500 0x7f5be8070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 -- 172.21.15.153:0/801454434 >> 172.21.15.153:0/801454434 conn(0x7f5be80cff40 msgr2=0x7f5be80d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 -- 172.21.15.153:0/801454434 shutdown_connections 2024-09-17T03:15:42.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.257+0000 7f5bed000640 1 -- 172.21.15.153:0/801454434 wait complete. 2024-09-17T03:15:42.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.259+0000 7f5bed000640 1 Processor -- start 2024-09-17T03:15:42.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.260+0000 7f5bed000640 1 -- start start 2024-09-17T03:15:42.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 0x7f5be80b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5be815b500 0x7f5be80c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80cdc90 con 0x7f5be815f940 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80cdb10 con 0x7f5be8074b00 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bed000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f5be80cde10 con 0x7f5be815b500 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5be7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5be7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35006/0 (socket says 172.21.15.153:35006) 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5be7e00640 1 -- 172.21.15.153:0/57466876 learned_addr learned my addr 172.21.15.153:0/57466876 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5be7400640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 0x7f5be80b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.261+0000 7f5bdea00640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5be815b500 0x7f5be80c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 -- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5be815b500 msgr2=0x7f5be80c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5be815b500 0x7f5be80c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 -- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 msgr2=0x7f5be80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 0x7f5be80b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 -- 172.21.15.153:0/57466876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be814f910 con 0x7f5be815f940 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7400640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 0x7f5be80b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5be7e00640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5be000b9a0 tx=0x7f5be000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0019070 con 0x7f5be815f940 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be000cc90 con 0x7f5be815f940 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00146a0 con 0x7f5be815f940 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.262+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be80b5b60 con 0x7f5be815f940 2024-09-17T03:15:42.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.263+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be80c8af0 con 0x7f5be815f940 2024-09-17T03:15:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.264+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be815f1b0 con 0x7f5be815f940 2024-09-17T03:15:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.265+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5be001c070 con 0x7f5be815f940 2024-09-17T03:15:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.266+0000 7f5bdfe00640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 0x7f5bc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.266+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f5be009a6b0 con 0x7f5be815f940 2024-09-17T03:15:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.266+0000 7f5be7400640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 0x7f5bc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.267+0000 7f5be7400640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 0x7f5bc407b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800bbb0 tx=0x7f5bd8005ec0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.270+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5be814f910 con 0x7f5be815f940 2024-09-17T03:15:42.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.455+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5be80cfc30 con 0x7f5be815f940 2024-09-17T03:15:42.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.460+0000 7f5bdfe00640 1 -- 172.21.15.153:0/57466876 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f5be0062650 con 0x7f5be815f940 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 msgr2=0x7f5bc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 0x7f5bc407b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800bbb0 tx=0x7f5bd8005ec0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 msgr2=0x7f5be814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5be000b9a0 tx=0x7f5be000be60 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 shutdown_connections 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5bc4078bc0 0x7f5bc407b0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5be815f940 0x7f5be814f3d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5be815b500 0x7f5be80c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 --2- 172.21.15.153:0/57466876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5be8074b00 0x7f5be80b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.462+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 >> 172.21.15.153:0/57466876 conn(0x7f5be80cff40 msgr2=0x7f5be806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.463+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 shutdown_connections 2024-09-17T03:15:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:42.463+0000 7f5bed000640 1 -- 172.21.15.153:0/57466876 wait complete. 2024-09-17T03:15:42.484 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:15:42.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:42.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:42.665 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:15:42.665 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:42.665 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:42.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:42.702 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:15:42.702 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:42.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:42.738 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:42.739 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:42.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:42.777 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:15:42.778 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:42.813 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:42.814 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:15:42.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 -- 172.21.15.153:0/2245194563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 msgr2=0x7f9144073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 --2- 172.21.15.153:0/2245194563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f9144073e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9134009830 tx=0x7f913402a480 comp rx=0 tx=0).stop 2024-09-17T03:15:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 -- 172.21.15.153:0/2245194563 shutdown_connections 2024-09-17T03:15:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 --2- 172.21.15.153:0/2245194563 >> v2:172.21.15.164:3300/0 conn(0x7f914406f350 0x7f91440caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 --2- 172.21.15.153:0/2245194563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f9144073e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 -- 172.21.15.153:0/2245194563 >> 172.21.15.153:0/2245194563 conn(0x7f91440d0070 msgr2=0x7f91440d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 -- 172.21.15.153:0/2245194563 shutdown_connections 2024-09-17T03:15:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.041+0000 7f9149800640 1 -- 172.21.15.153:0/2245194563 wait complete. 2024-09-17T03:15:43.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.043+0000 7f9149800640 1 Processor -- start 2024-09-17T03:15:43.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.043+0000 7f9149800640 1 -- start start 2024-09-17T03:15:43.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f91440c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9144150b50 0x7f914414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91440cb8a0 con 0x7f91440749c0 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f91440cb720 con 0x7f9144150b50 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9149800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f91440cba20 con 0x7f914415c790 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35020/0 (socket says 172.21.15.153:35020) 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142a00640 1 -- 172.21.15.153:0/1698281541 learned_addr learned my addr 172.21.15.153:0/1698281541 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142000640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f91440c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9143400640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9144150b50 0x7f914414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142a00640 1 -- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 msgr2=0x7f91440c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.045+0000 7f9142a00640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f91440c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9142a00640 1 -- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9144150b50 msgr2=0x7f914414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9142a00640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9144150b50 0x7f914414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9142a00640 1 -- 172.21.15.153:0/1698281541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91440c3e60 con 0x7f91440749c0 2024-09-17T03:15:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9142a00640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f913402aa70 tx=0x7f9134033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134005c90 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9134031e50 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134005260 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91440b49c0 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.046+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91440b4f80 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.047+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91440cbf40 con 0x7f91440749c0 2024-09-17T03:15:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.048+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9134005400 con 0x7f91440749c0 2024-09-17T03:15:43.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.049+0000 7f913aa00640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 0x7f912407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.049+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7f91340bbc50 con 0x7f91440749c0 2024-09-17T03:15:43.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.050+0000 7f9142000640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 0x7f912407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.051+0000 7f9142000640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 0x7f912407b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9130007fd0 tx=0x7f91300013b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:43.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.054+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f913403f030 con 0x7f91440749c0 2024-09-17T03:15:43.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.270+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91440d0890 con 0x7f91440749c0 2024-09-17T03:15:43.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.271+0000 7f913aa00640 1 -- 172.21.15.153:0/1698281541 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3905 (secure 0 0 0) 0x7f9134083ac0 con 0x7f91440749c0 2024-09-17T03:15:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:43.270 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":27,"btime":"2024-09-17T03:15:35:514698+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4955,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/1293830173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":1293830173},{"type":"v1","addr":"172.21.15.164:6837","nonce":1293830173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1721005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1721005},{"type":"v1","addr":"172.21.15.164:6836","nonce":1721005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/8823958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":8823958},{"type":"v1","addr":"172.21.15.153:6833","nonce":8823958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5349,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2878009449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2878009449},{"type":"v1","addr":"172.21.15.153:6835","nonce":2878009449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-09-17T03:15:43.270 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 27 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 msgr2=0x7f912407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 0x7f912407b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9130007fd0 tx=0x7f91300013b0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 msgr2=0x7f91440b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f913402aa70 tx=0x7f9134033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 shutdown_connections 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9124078bc0 0x7f912407b0d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9144150b50 0x7f914414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f914415c790 0x7f91440c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 --2- 172.21.15.153:0/1698281541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91440749c0 0x7f91440b54a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 >> 172.21.15.153:0/1698281541 conn(0x7f91440d0070 msgr2=0x7f914415b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.273+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 shutdown_connections 2024-09-17T03:15:43.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.274+0000 7f9149800640 1 -- 172.21.15.153:0/1698281541 wait complete. 2024-09-17T03:15:43.294 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:15:43.294 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:15:43.295 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:15:43.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:43.295 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:15:43.295 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:15:43.295 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:15:43.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:43.296 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:15:43.296 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:15:43.296 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:15:43.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:43.296 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:15:43.296 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:15:43.296 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:15:43.296 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:43.319 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:15:43.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:15:43.320 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:15:43.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:15:43.323 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:15:43.323 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:15:43.324 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:15:43.324 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:15:43.363 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:15:43.363 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:43.366 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:15:43.366 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:43.368 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:15:43.368 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:43.370 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:15:43.370 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:43.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:15:43.562 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:15:43.563 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-09-17T03:15:43.566 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:15:43.567 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 -- 172.21.15.153:0/9114999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf8073e20 msgr2=0x7fdaf806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 --2- 172.21.15.153:0/9114999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf8073e20 0x7fdaf806ec40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80cc6f0 tx=0x7fdae402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 -- 172.21.15.153:0/9114999 shutdown_connections 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 --2- 172.21.15.153:0/9114999 >> v2:172.21.15.164:3300/0 conn(0x7fdaf806f180 0x7fdaf80caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 --2- 172.21.15.153:0/9114999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf8073e20 0x7fdaf806ec40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 -- 172.21.15.153:0/9114999 >> 172.21.15.153:0/9114999 conn(0x7fdaf80d0070 msgr2=0x7fdaf80d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 -- 172.21.15.153:0/9114999 shutdown_connections 2024-09-17T03:15:43.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.609+0000 7fdafee00640 1 -- 172.21.15.153:0/9114999 wait complete. 2024-09-17T03:15:43.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.612+0000 7fdafee00640 1 Processor -- start 2024-09-17T03:15:43.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.612+0000 7fdafee00640 1 -- start start 2024-09-17T03:15:43.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 0x7fdaf809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf815c790 0x7fdaf81eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80cb8a0 con 0x7fdaf806f180 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80cb720 con 0x7fdaf815c790 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.613+0000 7fdafee00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf80cba20 con 0x7fdaf8073e20 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35072/0 (socket says 172.21.15.153:35072) 2024-09-17T03:15:43.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 -- 172.21.15.153:0/477966451 learned_addr learned my addr 172.21.15.153:0/477966451 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:43.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7400640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 0x7fdaf809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdafce00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf815c790 0x7fdaf81eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 -- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 msgr2=0x7fdaf809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 0x7fdaf809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 -- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf815c790 msgr2=0x7fdaf81eeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf815c790 0x7fdaf81eeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 -- 172.21.15.153:0/477966451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf81f5620 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7400640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 0x7fdaf809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.614+0000 7fdaf7e00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c390 tx=0x7fdae800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.615+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8017070 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.615+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdae80035f0 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.615+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf81f5900 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.615+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8003a20 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.615+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf81f5ec0 con 0x7fdaf806f180 2024-09-17T03:15:43.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.616+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf80cbff0 con 0x7fdaf806f180 2024-09-17T03:15:43.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.617+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdae801a070 con 0x7fdaf806f180 2024-09-17T03:15:43.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.618+0000 7fdaefe00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 0x7fdad807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:43.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.618+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5421+0+0 (secure 0 0 0) 0x7fdae8099f50 con 0x7fdaf806f180 2024-09-17T03:15:43.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.618+0000 7fdaf7400640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 0x7fdad807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:43.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.619+0000 7fdaf7400640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 0x7fdad807b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034000 tx=0x7fdae4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:43.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.622+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdaf806f590 con 0x7fdaf806f180 2024-09-17T03:15:43.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:43.816+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fdaf815f250 con 0x7fdaf806f180 2024-09-17T03:15:44.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.581+0000 7fdaefe00640 1 -- 172.21.15.153:0/477966451 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) ==== 97+0+0 (secure 0 0 0) 0x7fdae80624b0 con 0x7fdaf806f180 2024-09-17T03:15:44.580 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2024-09-17T03:15:44.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 msgr2=0x7fdad807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:44.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 0x7fdad807b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdae4034000 tx=0x7fdae4004730 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 msgr2=0x7fdaf809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdae800c390 tx=0x7fdae800c850 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 shutdown_connections 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fdad8078b90 0x7fdad807b0a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdaf815c790 0x7fdaf81eeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdaf8073e20 0x7fdaf809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 --2- 172.21.15.153:0/477966451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaf806f180 0x7fdaf809aa70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 >> 172.21.15.153:0/477966451 conn(0x7fdaf80d0070 msgr2=0x7fdaf80af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.584+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 shutdown_connections 2024-09-17T03:15:44.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.585+0000 7fdafee00640 1 -- 172.21.15.153:0/477966451 wait complete. 2024-09-17T03:15:44.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 -- 172.21.15.153:0/1369230193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 msgr2=0x7fe29006ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 --2- 172.21.15.153:0/1369230193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe29006ec40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe2900c3b70 tx=0x7fe28002a530 comp rx=0 tx=0).stop 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 -- 172.21.15.153:0/1369230193 shutdown_connections 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 --2- 172.21.15.153:0/1369230193 >> v2:172.21.15.164:3300/0 conn(0x7fe29006f180 0x7fe2900cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 --2- 172.21.15.153:0/1369230193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe29006ec40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 -- 172.21.15.153:0/1369230193 >> 172.21.15.153:0/1369230193 conn(0x7fe2900d0070 msgr2=0x7fe2900d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 -- 172.21.15.153:0/1369230193 shutdown_connections 2024-09-17T03:15:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.835+0000 7fe296000640 1 -- 172.21.15.153:0/1369230193 wait complete. 2024-09-17T03:15:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.837+0000 7fe296000640 1 Processor -- start 2024-09-17T03:15:44.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.838+0000 7fe296000640 1 -- start start 2024-09-17T03:15:44.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 0x7fe29015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:44.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2900cf230 0x7fe29009d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900cb8a0 con 0x7fe290070d90 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900cb720 con 0x7fe29006f180 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe296000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe2900cba20 con 0x7fe2900cf230 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55540/0 (socket says 172.21.15.153:55540) 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.839+0000 7fe28ea00640 1 -- 172.21.15.153:0/3880186621 learned_addr learned my addr 172.21.15.153:0/3880186621 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28f400640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 0x7fe29015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 -- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2900cf230 msgr2=0x7fe29009d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2900cf230 0x7fe29009d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 -- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 msgr2=0x7fe29015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 0x7fe29015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 -- 172.21.15.153:0/3880186621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2900b4020 con 0x7fe290070d90 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28f400640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 0x7fe29015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe28ea00640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00d780 tx=0x7fe27c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c017070 con 0x7fe290070d90 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c00de90 con 0x7fe290070d90 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2900b4300 con 0x7fe290070d90 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0099d0 con 0x7fe290070d90 2024-09-17T03:15:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.840+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2900b48c0 con 0x7fe290070d90 2024-09-17T03:15:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.841+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29009d9d0 con 0x7fe290070d90 2024-09-17T03:15:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.843+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe27c009b70 con 0x7fe290070d90 2024-09-17T03:15:44.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.844+0000 7fe287400640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:44.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.844+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5249+0+0 (secure 0 0 0) 0x7fe27c09afb0 con 0x7fe290070d90 2024-09-17T03:15:44.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.845+0000 7fe28f400640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:44.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.846+0000 7fe28f400640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 0x7fe27007b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe280004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:44.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:44.849+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe27c020020 con 0x7fe290070d90 2024-09-17T03:15:45.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.099+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe2900cc340 con 0x7fe290070d90 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.100+0000 7fe287400640 1 -- 172.21.15.153:0/3880186621 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fe27c063510 con 0x7fe290070d90 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmLHZRBBAAGmAg1KpwGuZFL9Quv0LYcA==", 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.099 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmSI4xIBAAkjTGfzL4FBI0yMQYlitmnw==", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmR5dFEhAA9EF++beLMAzGgqO5hUf1dQ==", 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmx/wZLhAACTfMeHYPEOv9h22zpC47MQ==", 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.102 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCe8+hmUJHDHBAA6lJxR23sbaAInNreyCzTVw==", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCh8+hmNzIiLhAA5aJqW/7GiFmCUqkF0uRMWA==", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.103 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCl8+hmjy5MARAA4WMewB9KHsaanVAyoxoVlQ==", 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCo8+hm2n3MDRAAR4L8JPU3RpxMVx8Mj36Gcg==", 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2024-09-17T03:15:45.105 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCu8+hmxBHHDhAAKmnlrNMTbfXPOyZYfJcO5g==", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCx8+hm/R5RLBAA3nlpiixH68Vs3ElVKgYisA==", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQC18+hmCLP0DBAA9BMFyyme36fx/dC2OYI+wg==", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQC48+hmaE0GHBAA2ngLlx3/ugZDkkn4KaNWWw==", 2024-09-17T03:15:45.107 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ==", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2024-09-17T03:15:45.108 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmX/ojFBAAiMU/0oZB//5zuXTfSUXNJQ==", 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmGy6SCRAAMo8JLvT0xfsNkU2Egh4HIg==", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCb8+hmLQG2HhAAQK4EusAMkZ3Vreg5HWt1tA==", 2024-09-17T03:15:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmabKoAxAAl8Hd8k/ANizp7sDkI2lQhg==", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2024-09-17T03:15:45.111 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmqFsANRAADCbozffXEEbgM48FQ9enKQ==", 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.112 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCZ8+hmMSoAKhAAj3XmUlPA9YUsAJZpdvPhjQ==", 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-17T03:15:45.113 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:15:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 msgr2=0x7fe27007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 0x7fe27007b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe280004730 comp rx=0 tx=0).stop 2024-09-17T03:15:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 msgr2=0x7fe2900b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00d780 tx=0x7fe27c00dc40 comp rx=0 tx=0).stop 2024-09-17T03:15:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 shutdown_connections 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2900cf230 0x7fe29009d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe290070d90 0x7fe2900b50c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 --2- 172.21.15.153:0/3880186621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe29006f180 0x7fe29015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 >> 172.21.15.153:0/3880186621 conn(0x7fe2900d0070 msgr2=0x7fe2901619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 shutdown_connections 2024-09-17T03:15:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.102+0000 7fe296000640 1 -- 172.21.15.153:0/3880186621 wait complete. 2024-09-17T03:15:45.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:15:45.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 -- 172.21.15.153:0/109949698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf20073c40 msgr2=0x7faf20074050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 --2- 172.21.15.153:0/109949698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf20073c40 0x7faf20074050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faf18005fd0 tx=0x7faf1802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 -- 172.21.15.153:0/109949698 shutdown_connections 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 --2- 172.21.15.153:0/109949698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf20073c40 0x7faf20074050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 --2- 172.21.15.153:0/109949698 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 0x7faf20073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 -- 172.21.15.153:0/109949698 >> 172.21.15.153:0/109949698 conn(0x7faf200b19c0 msgr2=0x7faf200b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 -- 172.21.15.153:0/109949698 shutdown_connections 2024-09-17T03:15:45.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.346+0000 7faf26600640 1 -- 172.21.15.153:0/109949698 wait complete. 2024-09-17T03:15:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.349+0000 7faf26600640 1 Processor -- start 2024-09-17T03:15:45.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.349+0000 7faf26600640 1 -- start start 2024-09-17T03:15:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 0x7faf200addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 0x7faf2014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf2015aec0 con 0x7faf20073c40 2024-09-17T03:15:45.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf2015ad40 con 0x7faf200cb380 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf26600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf2015b040 con 0x7faf200700e0 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.350+0000 7faf17e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55554/0 (socket says 172.21.15.153:55554) 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 -- 172.21.15.153:0/391032517 learned_addr learned my addr 172.21.15.153:0/391032517 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf25c00640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 0x7faf2014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf25200640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 0x7faf200addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 -- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 msgr2=0x7faf200addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 0x7faf200addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 -- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 msgr2=0x7faf2014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 0x7faf2014f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 -- 172.21.15.153:0/391032517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf200b34c0 con 0x7faf20073c40 2024-09-17T03:15:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf25c00640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 0x7faf2014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:45.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.351+0000 7faf17e00640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e790 tx=0x7faf0800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.352+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800eea0 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.352+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf0800cdb0 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.352+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08010690 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.352+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf200b37a0 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.352+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf200b3d60 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.353+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf20073700 con 0x7faf20073c40 2024-09-17T03:15:45.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.354+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf08010830 con 0x7faf20073c40 2024-09-17T03:15:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.355+0000 7faf1d600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 0x7faefc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.355+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5249+0+0 (secure 0 0 0) 0x7faf0809b610 con 0x7faf20073c40 2024-09-17T03:15:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.355+0000 7faf25200640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 0x7faefc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.356+0000 7faf25200640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 0x7faefc07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf20072bd0 tx=0x7faf10009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:45.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.359+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf08063b80 con 0x7faf20073c40 2024-09-17T03:15:45.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.542+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faf200cfba0 con 0x7faf20073c40 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.543+0000 7faf1d600640 1 -- 172.21.15.153:0/391032517 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) ==== 84+0+65 (secure 0 0 0) 0x7faf08063480 con 0x7faf20073c40 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": ".mgr" 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-17T03:15:45.542 INFO:teuthology.orchestra.run.smithi153.stdout:] 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 msgr2=0x7faefc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 0x7faefc07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf20072bd0 tx=0x7faf10009040 comp rx=0 tx=0).stop 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 msgr2=0x7faf201f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e790 tx=0x7faf0800ec50 comp rx=0 tx=0).stop 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 shutdown_connections 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faefc078b90 0x7faefc07b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf200cb380 0x7faf2014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf20073c40 0x7faf201f5480 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 --2- 172.21.15.153:0/391032517 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf200700e0 0x7faf200addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 >> 172.21.15.153:0/391032517 conn(0x7faf200b19c0 msgr2=0x7faf2009ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 shutdown_connections 2024-09-17T03:15:45.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.545+0000 7faf26600640 1 -- 172.21.15.153:0/391032517 wait complete. 2024-09-17T03:15:45.566 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:15:45.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:15:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.792+0000 7f2393400640 1 -- 172.21.15.153:0/3500376223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 msgr2=0x7f238c0737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.792+0000 7f2393400640 1 --2- 172.21.15.153:0/3500376223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0737b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2384005fd0 tx=0x7f238402a870 comp rx=0 tx=0).stop 2024-09-17T03:15:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 -- 172.21.15.153:0/3500376223 shutdown_connections 2024-09-17T03:15:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 --2- 172.21.15.153:0/3500376223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0737b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 --2- 172.21.15.153:0/3500376223 >> v2:172.21.15.164:3300/0 conn(0x7f238c145c50 0x7f238c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 -- 172.21.15.153:0/3500376223 >> 172.21.15.153:0/3500376223 conn(0x7f238c06cd90 msgr2=0x7f238c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 -- 172.21.15.153:0/3500376223 shutdown_connections 2024-09-17T03:15:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.793+0000 7f2393400640 1 -- 172.21.15.153:0/3500376223 wait complete. 2024-09-17T03:15:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.795+0000 7f2393400640 1 Processor -- start 2024-09-17T03:15:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.795+0000 7f2393400640 1 -- start start 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.796+0000 7f2393400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.796+0000 7f2393400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f238c0ceee0 0x7f238c1f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.796+0000 7f2393400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f238c145c50 0x7f238c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2393400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f238c073e70 con 0x7f238c0b2130 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2393400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f238c073cf0 con 0x7f238c145c50 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2393400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f238c073ff0 con 0x7f238c0ceee0 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55564/0 (socket says 172.21.15.153:55564) 2024-09-17T03:15:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 -- 172.21.15.153:0/1061954769 learned_addr learned my addr 172.21.15.153:0/1061954769 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2391400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f238c145c50 0x7f238c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f238be00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f238c0ceee0 0x7f238c1f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 -- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f238c0ceee0 msgr2=0x7f238c1f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f238c0ceee0 0x7f238c1f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 -- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f238c145c50 msgr2=0x7f238c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f238c145c50 0x7f238c156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 -- 172.21.15.153:0/1061954769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c143f90 con 0x7f238c0b2130 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.797+0000 7f2390a00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f238000c3c0 tx=0x7f238000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.798+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380017070 con 0x7f238c0b2130 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.798+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23800035f0 con 0x7f238c0b2130 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.798+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c144fd0 con 0x7f238c0b2130 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.798+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380003a80 con 0x7f238c0b2130 2024-09-17T03:15:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.798+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1444f0 con 0x7f238c0b2130 2024-09-17T03:15:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.799+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c074520 con 0x7f238c0b2130 2024-09-17T03:15:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.800+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f238001a070 con 0x7f238c0b2130 2024-09-17T03:15:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.801+0000 7f2388c00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 0x7f236c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.801+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5249+0+0 (secure 0 0 0) 0x7f2380099f10 con 0x7f238c0b2130 2024-09-17T03:15:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.802+0000 7f238be00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 0x7f236c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.802+0000 7f238be00640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 0x7f236c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f238c154970 tx=0x7f2378005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.805+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f238c143f90 con 0x7f238c0b2130 2024-09-17T03:15:45.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:45.989+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f238c1539d0 con 0x7f238c0b2130 2024-09-17T03:15:46.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.594+0000 7f2388c00640 1 -- 172.21.15.153:0/1061954769 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) ==== 138+0+0 (secure 0 0 0) 0x7f238c0b2540 con 0x7f238c0b2130 2024-09-17T03:15:46.594 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.597+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 msgr2=0x7f236c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.597+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 0x7f236c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f238c154970 tx=0x7f2378005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.597+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 msgr2=0x7f238c0a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.597+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f238000c3c0 tx=0x7f238000c880 comp rx=0 tx=0).stop 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 shutdown_connections 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f236c078b90 0x7f236c07b0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f238c145c50 0x7f238c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f238c0ceee0 0x7f238c1f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 --2- 172.21.15.153:0/1061954769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f238c0b2130 0x7f238c0a99e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 >> 172.21.15.153:0/1061954769 conn(0x7f238c06cd90 msgr2=0x7f238c0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 shutdown_connections 2024-09-17T03:15:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.598+0000 7f2393400640 1 -- 172.21.15.153:0/1061954769 wait complete. 2024-09-17T03:15:46.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:15:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.853+0000 7f9266600640 1 -- 172.21.15.153:0/3422888128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9244004d90 msgr2=0x7f9244005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.853+0000 7f9266600640 1 --2- 172.21.15.153:0/3422888128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9244004d90 0x7f9244005220 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f925800c560 tx=0x7f9244005830 comp rx=0 tx=0).stop 2024-09-17T03:15:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.854+0000 7f925fe00640 1 -- 172.21.15.153:0/3422888128 reap_dead start 2024-09-17T03:15:46.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.854+0000 7f9266600640 1 -- 172.21.15.153:0/3422888128 shutdown_connections 2024-09-17T03:15:46.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.854+0000 7f9266600640 1 -- 172.21.15.153:0/3422888128 >> 172.21.15.153:0/3422888128 conn(0x7f92600b1df0 msgr2=0x7f92600b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:46.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.854+0000 7f9266600640 1 -- 172.21.15.153:0/3422888128 shutdown_connections 2024-09-17T03:15:46.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.854+0000 7f9266600640 1 -- 172.21.15.153:0/3422888128 wait complete. 2024-09-17T03:15:46.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.856+0000 7f9266600640 1 Processor -- start 2024-09-17T03:15:46.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.856+0000 7f9266600640 1 -- start start 2024-09-17T03:15:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.857+0000 7f9266600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9244004d90 0x7f92600b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f9266600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f9266600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92601f8430 0x7f92601f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f9266600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92600cd520 con 0x7f92600c3c10 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f9266600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f92600cd3a0 con 0x7f9244004d90 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f9266600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f92600743b0 con 0x7f92601f8430 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55592/0 (socket says 172.21.15.153:55592) 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 -- 172.21.15.153:0/3662123148 learned_addr learned my addr 172.21.15.153:0/3662123148 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925f400640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9244004d90 0x7f92600b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925fe00640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92601f8430 0x7f92601f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 -- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92601f8430 msgr2=0x7f92601f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92601f8430 0x7f92601f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 -- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9244004d90 msgr2=0x7f92600b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9244004d90 0x7f92600b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.858+0000 7f925ea00640 1 -- 172.21.15.153:0/3662123148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92601f8d80 con 0x7f92600c3c10 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f925ea00640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f924c011ae0 tx=0x7f924c009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c01e070 con 0x7f92600c3c10 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f924c004460 con 0x7f92600c3c10 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926015aa70 con 0x7f92600c3c10 2024-09-17T03:15:46.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c00fc60 con 0x7f92600c3c10 2024-09-17T03:15:46.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.859+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926015d8b0 con 0x7f92600c3c10 2024-09-17T03:15:46.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.860+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9260074910 con 0x7f92600c3c10 2024-09-17T03:15:46.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.862+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f924c021070 con 0x7f92600c3c10 2024-09-17T03:15:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.863+0000 7f9257400640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 0x7f924007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.863+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5619+0+0 (secure 0 0 0) 0x7f924c09b770 con 0x7f92600c3c10 2024-09-17T03:15:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.863+0000 7f925f400640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 0x7f924007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.864+0000 7f925f400640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 0x7f924007b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9250006fd0 tx=0x7f9250006b10 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:46.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:46.868+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92601f8d80 con 0x7f92600c3c10 2024-09-17T03:15:47.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.053+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f926006dda0 con 0x7f92600c3c10 2024-09-17T03:15:47.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.601+0000 7f9257400640 1 -- 172.21.15.153:0/3662123148 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) ==== 170+0+0 (secure 0 0 0) 0x7f924c0635b0 con 0x7f92600c3c10 2024-09-17T03:15:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.604+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 msgr2=0x7f924007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.604+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 0x7f924007b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9250006fd0 tx=0x7f9250006b10 comp rx=0 tx=0).stop 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.604+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 msgr2=0x7f92601f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.604+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f924c011ae0 tx=0x7f924c009e40 comp rx=0 tx=0).stop 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 shutdown_connections 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9240078b90 0x7f924007b0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f92601f8430 0x7f92601f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92600c3c10 0x7f92601f2180 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 --2- 172.21.15.153:0/3662123148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9244004d90 0x7f92600b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 >> 172.21.15.153:0/3662123148 conn(0x7f92600b1df0 msgr2=0x7f92600ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 shutdown_connections 2024-09-17T03:15:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.605+0000 7f9266600640 1 -- 172.21.15.153:0/3662123148 wait complete. 2024-09-17T03:15:47.645 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 -- 172.21.15.153:0/2929154212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10004040 msgr2=0x7f3a10004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 --2- 172.21.15.153:0/2929154212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10004040 0x7f3a10004800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800bb20 tx=0x7f3a10005830 comp rx=0 tx=0).stop 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a2be00640 1 -- 172.21.15.153:0/2929154212 reap_dead start 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 -- 172.21.15.153:0/2929154212 shutdown_connections 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 -- 172.21.15.153:0/2929154212 >> 172.21.15.153:0/2929154212 conn(0x7f3a2c09d640 msgr2=0x7f3a2c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:47.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 -- 172.21.15.153:0/2929154212 shutdown_connections 2024-09-17T03:15:47.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.871+0000 7f3a31200640 1 -- 172.21.15.153:0/2929154212 wait complete. 2024-09-17T03:15:47.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.873+0000 7f3a31200640 1 Processor -- start 2024-09-17T03:15:47.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.873+0000 7f3a31200640 1 -- start start 2024-09-17T03:15:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 0x7f3a2c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a2c154050 0x7f3a2c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b7410 con 0x7f3a2c154a30 2024-09-17T03:15:47.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cfd30 con 0x7f3a10004040 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a31200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b7590 con 0x7f3a2c154050 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55616/0 (socket says 172.21.15.153:55616) 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 -- 172.21.15.153:0/2206568457 learned_addr learned my addr 172.21.15.153:0/2206568457 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2b400640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 0x7f3a2c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2be00640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a2c154050 0x7f3a2c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 -- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a2c154050 msgr2=0x7f3a2c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a2c154050 0x7f3a2c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 -- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 msgr2=0x7f3a2c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 0x7f3a2c153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2aa00640 1 -- 172.21.15.153:0/2206568457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c153e50 con 0x7f3a2c154a30 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.875+0000 7f3a2b400640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 0x7f3a2c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:47.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a2aa00640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800bc40 tx=0x7f3a1800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18040070 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a1803a920 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18035040 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c1f5390 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.876+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c1f5930 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.877+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c154f80 con 0x7f3a2c154a30 2024-09-17T03:15:47.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.879+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a18038020 con 0x7f3a2c154a30 2024-09-17T03:15:47.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.880+0000 7f3a23400640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 0x7f3a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.880+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6001+0+0 (secure 0 0 0) 0x7f3a180bc4e0 con 0x7f3a2c154a30 2024-09-17T03:15:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.880+0000 7f3a2b400640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 0x7f3a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:47.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.881+0000 7f3a2b400640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 0x7f3a0c07b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c001470 tx=0x7f3a1c006bd0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:47.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:47.883+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a2c153e50 con 0x7f3a2c154a30 2024-09-17T03:15:48.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.100+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3a2c0cf420 con 0x7f3a2c154a30 2024-09-17T03:15:48.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.603+0000 7f3a23400640 1 -- 172.21.15.153:0/2206568457 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v30) ==== 172+0+0 (secure 0 0 0) 0x7f3a180847e0 con 0x7f3a2c154a30 2024-09-17T03:15:48.603 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 7 and data pool 8 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 msgr2=0x7f3a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 0x7f3a0c07b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c001470 tx=0x7f3a1c006bd0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 msgr2=0x7f3a2c15b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800bc40 tx=0x7f3a1800b710 comp rx=0 tx=0).stop 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 shutdown_connections 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3a0c078b90 0x7f3a0c07b0a0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c001470 tx=0x7f3a1c006bd0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a2c154050 0x7f3a2c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a2c154a30 0x7f3a2c15b700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 --2- 172.21.15.153:0/2206568457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a10004040 0x7f3a2c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.608+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 >> 172.21.15.153:0/2206568457 conn(0x7f3a2c09d640 msgr2=0x7f3a2c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:48.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.610+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 shutdown_connections 2024-09-17T03:15:48.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.611+0000 7f3a31200640 1 -- 172.21.15.153:0/2206568457 wait complete. 2024-09-17T03:15:48.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.880+0000 7f0204800640 1 -- 172.21.15.153:0/878618912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01e4004800 msgr2=0x7f01e4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.880+0000 7f0204800640 1 --2- 172.21.15.153:0/878618912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01e4004800 0x7f01e4004c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f01ec001690 tx=0x7f01e4005830 comp rx=0 tx=0).stop 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.880+0000 7f0204800640 1 -- 172.21.15.153:0/878618912 shutdown_connections 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.880+0000 7f0204800640 1 --2- 172.21.15.153:0/878618912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01e4004800 0x7f01e4004c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.880+0000 7f0204800640 1 -- 172.21.15.153:0/878618912 >> 172.21.15.153:0/878618912 conn(0x7f01fc0d0070 msgr2=0x7f01fc0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.881+0000 7f0204800640 1 -- 172.21.15.153:0/878618912 shutdown_connections 2024-09-17T03:15:48.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.881+0000 7f0204800640 1 -- 172.21.15.153:0/878618912 wait complete. 2024-09-17T03:15:48.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.883+0000 7f0204800640 1 Processor -- start 2024-09-17T03:15:48.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.883+0000 7f0204800640 1 -- start start 2024-09-17T03:15:48.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01e4004800 0x7f01fc0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:48.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01fc1f8340 0x7f01fc1f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc06ec40 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc074de0 con 0x7f01fc1f8340 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.884+0000 7f0204800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc06edc0 con 0x7f01e4004800 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55634/0 (socket says 172.21.15.153:55634) 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 -- 172.21.15.153:0/2717727228 learned_addr learned my addr 172.21.15.153:0/2717727228 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201e00640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01e4004800 0x7f01fc0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0202800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01fc1f8340 0x7f01fc1f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:48.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 -- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01e4004800 msgr2=0x7f01fc0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01e4004800 0x7f01fc0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 -- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01fc1f8340 msgr2=0x7f01fc1f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01fc1f8340 0x7f01fc1f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.885+0000 7f0201400640 1 -- 172.21.15.153:0/2717727228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc1f8c90 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f0201400640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0017b0 tx=0x7f01ec0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec042070 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01ec039070 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc1e7c40 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003d70 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.886+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1f6320 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.887+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc06f320 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.889+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01ec03b070 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.889+0000 7f01f6000640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.890+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f01ec0ba440 con 0x7f01fc1e6fa0 2024-09-17T03:15:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.890+0000 7f0201e00640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:48.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.891+0000 7f0201e00640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 0x7f01e007b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01fc06bd00 tx=0x7f01f00067a0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:48.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:48.894+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01fc1f8c90 con 0x7f01fc1e6fa0 2024-09-17T03:15:49.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.080+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01fc0cc040 con 0x7f01fc1e6fa0 2024-09-17T03:15:49.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.081+0000 7f01f6000640 1 -- 172.21.15.153:0/2717727228 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16991 (secure 0 0 0) 0x7f01ec082090 con 0x7f01fc1e6fa0 2024-09-17T03:15:49.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":57,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:48.102014+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:15:46.001140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:15:47.065591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 msgr2=0x7f01e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 0x7f01e007b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01fc06bd00 tx=0x7f01f00067a0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 msgr2=0x7f01fc1e73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0017b0 tx=0x7f01ec0063a0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 shutdown_connections 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f01e0078b90 0x7f01e007b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01fc1f8340 0x7f01fc1f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01fc1e6fa0 0x7f01fc1e73b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 --2- 172.21.15.153:0/2717727228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f01e4004800 0x7f01fc0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 >> 172.21.15.153:0/2717727228 conn(0x7f01fc0d0070 msgr2=0x7f01fc0aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 shutdown_connections 2024-09-17T03:15:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.084+0000 7f0204800640 1 -- 172.21.15.153:0/2717727228 wait complete. 2024-09-17T03:15:49.105 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 -- 172.21.15.153:0/3989069498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5806f350 msgr2=0x7fed580caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 --2- 172.21.15.153:0/3989069498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5806f350 0x7fed580caf20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fed580cac10 tx=0x7fed5002a820 comp rx=0 tx=0).stop 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 -- 172.21.15.153:0/3989069498 shutdown_connections 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 --2- 172.21.15.153:0/3989069498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed5806f350 0x7fed580caf20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 --2- 172.21.15.153:0/3989069498 >> v2:172.21.15.164:3300/0 conn(0x7fed5815c790 0x7fed58073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 -- 172.21.15.153:0/3989069498 >> 172.21.15.153:0/3989069498 conn(0x7fed580d0070 msgr2=0x7fed580d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 -- 172.21.15.153:0/3989069498 shutdown_connections 2024-09-17T03:15:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.333+0000 7fed5f400640 1 -- 172.21.15.153:0/3989069498 wait complete. 2024-09-17T03:15:49.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.336+0000 7fed5f400640 1 Processor -- start 2024-09-17T03:15:49.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.336+0000 7fed5f400640 1 -- start start 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed5815c790 0x7fed580ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed580aea40 0x7fed581f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed580cb7f0 con 0x7fed580749c0 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed580cb670 con 0x7fed5815c790 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5f400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fed580cb970 con 0x7fed580aea40 2024-09-17T03:15:49.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.337+0000 7fed5ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55650/0 (socket says 172.21.15.153:55650) 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 -- 172.21.15.153:0/2732132131 learned_addr learned my addr 172.21.15.153:0/2732132131 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 -- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed580aea40 msgr2=0x7fed581f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed580aea40 0x7fed581f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 -- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed5815c790 msgr2=0x7fed580ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed5815c790 0x7fed580ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 -- 172.21.15.153:0/2732132131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5815dfd0 con 0x7fed580749c0 2024-09-17T03:15:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed5ca00640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed4800e790 tx=0x7fed4800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.338+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4800eea0 con 0x7fed580749c0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.339+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed4800ccc0 con 0x7fed580749c0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.339+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48004280 con 0x7fed580749c0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.339+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed581f9390 con 0x7fed580749c0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.339+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed580ad740 con 0x7fed580749c0 2024-09-17T03:15:49.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.340+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed580cbe70 con 0x7fed580749c0 2024-09-17T03:15:49.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.341+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed480035f0 con 0x7fed580749c0 2024-09-17T03:15:49.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.342+0000 7fed55600640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 0x7fed3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.342+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fed4809b8f0 con 0x7fed580749c0 2024-09-17T03:15:49.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.342+0000 7fed4fe00640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 0x7fed3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.343+0000 7fed4fe00640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 0x7fed3407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed40007fd0 tx=0x7fed40007900 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:49.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.347+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed48063b00 con 0x7fed580749c0 2024-09-17T03:15:49.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.530+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed580c8580 con 0x7fed580749c0 2024-09-17T03:15:49.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.531+0000 7fed55600640 1 -- 172.21.15.153:0/2732132131 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16991 (secure 0 0 0) 0x7fed48063400 con 0x7fed580749c0 2024-09-17T03:15:49.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":57,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:48.102014+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:15:46.001140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:15:47.065591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 msgr2=0x7fed3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 0x7fed3407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed40007fd0 tx=0x7fed40007900 comp rx=0 tx=0).stop 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 msgr2=0x7fed5815da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed4800e790 tx=0x7fed4800ec50 comp rx=0 tx=0).stop 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 shutdown_connections 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fed34078b90 0x7fed3407b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed580aea40 0x7fed581f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed5815c790 0x7fed580ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 --2- 172.21.15.153:0/2732132131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed580749c0 0x7fed5815da90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 >> 172.21.15.153:0/2732132131 conn(0x7fed580d0070 msgr2=0x7fed580cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 shutdown_connections 2024-09-17T03:15:49.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.534+0000 7fed5f400640 1 -- 172.21.15.153:0/2732132131 wait complete. 2024-09-17T03:15:49.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 -- 172.21.15.153:0/2468571190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800cef00 msgr2=0x7f8f8015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 --2- 172.21.15.153:0/2468571190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800cef00 0x7f8f8015d5e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8f80072540 tx=0x7f8f6802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 -- 172.21.15.153:0/2468571190 shutdown_connections 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 --2- 172.21.15.153:0/2468571190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 0x7f8f800b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 --2- 172.21.15.153:0/2468571190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800cef00 0x7f8f8015d5e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 --2- 172.21.15.153:0/2468571190 >> v2:172.21.15.164:3300/0 conn(0x7f8f800d0b80 0x7f8f800cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 -- 172.21.15.153:0/2468571190 >> 172.21.15.153:0/2468571190 conn(0x7f8f8006cf70 msgr2=0x7f8f8006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 -- 172.21.15.153:0/2468571190 shutdown_connections 2024-09-17T03:15:49.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.784+0000 7f8f85600640 1 -- 172.21.15.153:0/2468571190 wait complete. 2024-09-17T03:15:49.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.787+0000 7f8f85600640 1 Processor -- start 2024-09-17T03:15:49.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.787+0000 7f8f85600640 1 -- start start 2024-09-17T03:15:49.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 0x7f8f801545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f800cef00 0x7f8f801428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f800b4140 con 0x7f8f800d0b80 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8f800b3fc0 con 0x7f8f800cef00 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.788+0000 7f8f85600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8f800b42c0 con 0x7f8f800b1f80 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55678/0 (socket says 172.21.15.153:55678) 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 -- 172.21.15.153:0/2705963689 learned_addr learned my addr 172.21.15.153:0/2705963689 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f76000640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f800cef00 0x7f8f801428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7ea00640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 0x7f8f801545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 -- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 msgr2=0x7f8f801545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 0x7f8f801545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 -- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f800cef00 msgr2=0x7f8f801428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f800cef00 0x7f8f801428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 -- 172.21.15.153:0/2705963689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8014d380 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.789+0000 7f8f7f400640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e990 tx=0x7f8f7800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.790+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004d20 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.790+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f7800caa0 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.790+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78005020 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.790+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f80151430 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.790+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f801519f0 con 0x7f8f800d0b80 2024-09-17T03:15:49.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.791+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f800b4850 con 0x7f8f800d0b80 2024-09-17T03:15:49.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.792+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f780051c0 con 0x7f8f800d0b80 2024-09-17T03:15:49.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.793+0000 7f8f77400640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 0x7f8f5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:49.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.793+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f8f7809b520 con 0x7f8f800d0b80 2024-09-17T03:15:49.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.793+0000 7f8f7ea00640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 0x7f8f5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:49.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.794+0000 7f8f7ea00640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 0x7f8f5c07b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000bb50 tx=0x7f8f7000b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:49.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:49.797+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f8014d380 con 0x7f8f800d0b80 2024-09-17T03:15:50.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.017+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8f800b3620 con 0x7f8f800d0b80 2024-09-17T03:15:50.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.635+0000 7f8f77400640 1 -- 172.21.15.153:0/2705963689 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f8f78016030 con 0x7f8f800d0b80 2024-09-17T03:15:50.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 msgr2=0x7f8f5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:50.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 0x7f8f5c07b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000bb50 tx=0x7f8f7000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 msgr2=0x7f8f801524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e990 tx=0x7f8f7800ee50 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 shutdown_connections 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8f5c078bc0 0x7f8f5c07b0d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f800d0b80 0x7f8f801524d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f800cef00 0x7f8f801428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 --2- 172.21.15.153:0/2705963689 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8f800b1f80 0x7f8f801545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 >> 172.21.15.153:0/2705963689 conn(0x7f8f8006cf70 msgr2=0x7f8f8006f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.638+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 shutdown_connections 2024-09-17T03:15:50.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.639+0000 7f8f85600640 1 -- 172.21.15.153:0/2705963689 wait complete. 2024-09-17T03:15:50.659 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:15:50.659 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:15:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 -- 172.21.15.153:0/1665914130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4144074a90 msgr2=0x7f414415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 --2- 172.21.15.153:0/1665914130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4144074a90 0x7f414415ba30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f412c009830 tx=0x7f412c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 -- 172.21.15.153:0/1665914130 shutdown_connections 2024-09-17T03:15:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 --2- 172.21.15.153:0/1665914130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f414415bf70 0x7f4144072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 --2- 172.21.15.153:0/1665914130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4144074a90 0x7f414415ba30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 -- 172.21.15.153:0/1665914130 >> 172.21.15.153:0/1665914130 conn(0x7f414406cf70 msgr2=0x7f414406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 -- 172.21.15.153:0/1665914130 shutdown_connections 2024-09-17T03:15:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.886+0000 7f414a400640 1 -- 172.21.15.153:0/1665914130 wait complete. 2024-09-17T03:15:50.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.888+0000 7f414a400640 1 Processor -- start 2024-09-17T03:15:50.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.888+0000 7f414a400640 1 -- start start 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41440b3bc0 0x7f41441f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414414e190 0x7f4144157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4144073640 con 0x7f414415bf70 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f41440734c0 con 0x7f414414e190 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f414a400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f41440737c0 con 0x7f41440b3bc0 2024-09-17T03:15:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f413aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f413aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55690/0 (socket says 172.21.15.153:55690) 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f413aa00640 1 -- 172.21.15.153:0/1318186959 learned_addr learned my addr 172.21.15.153:0/1318186959 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f4143400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41440b3bc0 0x7f41441f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.890+0000 7f4143e00640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414414e190 0x7f4144157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 -- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41440b3bc0 msgr2=0x7f41441f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41440b3bc0 0x7f41441f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 -- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414414e190 msgr2=0x7f4144157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414414e190 0x7f4144157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 -- 172.21.15.153:0/1318186959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4144156090 con 0x7f414415bf70 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413aa00640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f412c009950 tx=0x7f412c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c005c90 con 0x7f414415bf70 2024-09-17T03:15:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f412c005020 con 0x7f414415bf70 2024-09-17T03:15:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c005450 con 0x7f414415bf70 2024-09-17T03:15:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4144157110 con 0x7f414415bf70 2024-09-17T03:15:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.891+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4144156630 con 0x7f414415bf70 2024-09-17T03:15:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.892+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414414e610 con 0x7f414415bf70 2024-09-17T03:15:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.894+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f412c0317c0 con 0x7f414415bf70 2024-09-17T03:15:50.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.895+0000 7f413be00640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 0x7f412007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:50.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.895+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f412c0bbf30 con 0x7f414415bf70 2024-09-17T03:15:50.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.895+0000 7f4143400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 0x7f412007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:50.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.896+0000 7f4143400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 0x7f412007b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4134007960 tx=0x7f4134001d50 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:50.899+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f412c03f030 con 0x7f414415bf70 2024-09-17T03:15:51.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.117+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f414415ba30 con 0x7f414415bf70 2024-09-17T03:15:51.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.642+0000 7f413be00640 1 -- 172.21.15.153:0/1318186959 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f412c083af0 con 0x7f414415bf70 2024-09-17T03:15:51.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 msgr2=0x7f412007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:51.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 0x7f412007b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4134007960 tx=0x7f4134001d50 comp rx=0 tx=0).stop 2024-09-17T03:15:51.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 msgr2=0x7f414414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:51.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f412c009950 tx=0x7f412c003c10 comp rx=0 tx=0).stop 2024-09-17T03:15:51.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 shutdown_connections 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4120078b90 0x7f412007b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414414e190 0x7f4144157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f414415bf70 0x7f414414dc50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 --2- 172.21.15.153:0/1318186959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f41440b3bc0 0x7f41441f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 >> 172.21.15.153:0/1318186959 conn(0x7f414406cf70 msgr2=0x7f414406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 shutdown_connections 2024-09-17T03:15:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.645+0000 7f414a400640 1 -- 172.21.15.153:0/1318186959 wait complete. 2024-09-17T03:15:51.666 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:15:51.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:51.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 -- 172.21.15.153:0/2807934137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 msgr2=0x7f952c073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 --2- 172.21.15.153:0/2807934137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c073e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f952c0cc6c0 tx=0x7f952002a980 comp rx=0 tx=0).stop 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 -- 172.21.15.153:0/2807934137 shutdown_connections 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 --2- 172.21.15.153:0/2807934137 >> v2:172.21.15.164:3300/0 conn(0x7f952c0749c0 0x7f952c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 --2- 172.21.15.153:0/2807934137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c073e20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 -- 172.21.15.153:0/2807934137 >> 172.21.15.153:0/2807934137 conn(0x7f952c0d0070 msgr2=0x7f952c0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 -- 172.21.15.153:0/2807934137 shutdown_connections 2024-09-17T03:15:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.887+0000 7f9534400640 1 -- 172.21.15.153:0/2807934137 wait complete. 2024-09-17T03:15:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.889+0000 7f9534400640 1 Processor -- start 2024-09-17T03:15:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.890+0000 7f9534400640 1 -- start start 2024-09-17T03:15:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f952c06f180 0x7f952c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f952c0749c0 0x7f952c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1609c0 con 0x7f952c15c790 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f952c160840 con 0x7f952c0749c0 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9534400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f952c160b40 con 0x7f952c06f180 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.891+0000 7f9532400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55702/0 (socket says 172.21.15.153:55702) 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 -- 172.21.15.153:0/4200988563 learned_addr learned my addr 172.21.15.153:0/4200988563 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9531000640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f952c0749c0 0x7f952c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9531a00640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f952c06f180 0x7f952c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:51.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 -- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f952c06f180 msgr2=0x7f952c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:51.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f952c06f180 0x7f952c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 -- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f952c0749c0 msgr2=0x7f952c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f952c0749c0 0x7f952c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 -- 172.21.15.153:0/4200988563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0b5970 con 0x7f952c15c790 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.892+0000 7f9532400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f952400b490 tx=0x7f952400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.893+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524015020 con 0x7f952c15c790 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.893+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c0b5c50 con 0x7f952c15c790 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.893+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9524011940 con 0x7f952c15c790 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.893+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524011d90 con 0x7f952c15c790 2024-09-17T03:15:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.893+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c0b5640 con 0x7f952c15c790 2024-09-17T03:15:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.894+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c06efa0 con 0x7f952c15c790 2024-09-17T03:15:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.895+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9524018020 con 0x7f952c15c790 2024-09-17T03:15:51.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.896+0000 7f9529600640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.896+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f952409ad50 con 0x7f952c15c790 2024-09-17T03:15:51.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.896+0000 7f9531a00640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:51.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.897+0000 7f9531a00640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 0x7f950c07b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9520035000 tx=0x7f9520004ab0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:51.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:51.901+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f952c06efa0 con 0x7f952c15c790 2024-09-17T03:15:52.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.119+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f952c1603b0 con 0x7f952c15c790 2024-09-17T03:15:52.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.120+0000 7f9529600640 1 -- 172.21.15.153:0/4200988563 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7f952401f020 con 0x7f952c15c790 2024-09-17T03:15:52.119 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:52.119 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"btime":"2024-09-17T03:15:51:637193+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3522404014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3522404014},{"type":"v1","addr":"172.21.15.164:6836","nonce":3522404014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2004529324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":2004529324},{"type":"v1","addr":"172.21.15.164:6837","nonce":2004529324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4173553541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4173553541},{"type":"v1","addr":"172.21.15.153:6835","nonce":4173553541}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:15:51.118681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1746730417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1746730417},{"type":"v1","addr":"172.21.15.153:6834","nonce":1746730417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5433,"qdb_cluster":[5433]},"id":3}]} 2024-09-17T03:15:52.119 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 34 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 msgr2=0x7f950c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 0x7f950c07b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9520035000 tx=0x7f9520004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 msgr2=0x7f952c15f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f952400b490 tx=0x7f952400b950 comp rx=0 tx=0).stop 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 shutdown_connections 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f952c15c790 0x7f952c15f280 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f952c0749c0 0x7f952c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 --2- 172.21.15.153:0/4200988563 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f952c06f180 0x7f952c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 >> 172.21.15.153:0/4200988563 conn(0x7f952c0d0070 msgr2=0x7f952c0ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:52.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 shutdown_connections 2024-09-17T03:15:52.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.123+0000 7f9534400640 1 -- 172.21.15.153:0/4200988563 wait complete. 2024-09-17T03:15:52.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 -- 172.21.15.153:0/91222489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a8072260 msgr2=0x7f71a815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 --2- 172.21.15.153:0/91222489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a8072260 0x7f71a815de50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7190005fd0 tx=0x7f719002a540 comp rx=0 tx=0).stop 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 -- 172.21.15.153:0/91222489 shutdown_connections 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 --2- 172.21.15.153:0/91222489 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a806cd90 0x7f71a806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 --2- 172.21.15.153:0/91222489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a8072260 0x7f71a815de50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 -- 172.21.15.153:0/91222489 >> 172.21.15.153:0/91222489 conn(0x7f71a80b2d50 msgr2=0x7f71a80b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:52.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 -- 172.21.15.153:0/91222489 shutdown_connections 2024-09-17T03:15:52.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.371+0000 7f71af000640 1 -- 172.21.15.153:0/91222489 wait complete. 2024-09-17T03:15:52.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.373+0000 7f71af000640 1 Processor -- start 2024-09-17T03:15:52.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.373+0000 7f71af000640 1 -- start start 2024-09-17T03:15:52.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71a8072260 0x7f71a8158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a815a420 0x7f71a81e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8074b70 con 0x7f71a806cd90 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80749f0 con 0x7f71a8072260 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71af000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f71a8074cf0 con 0x7f71a815a420 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55724/0 (socket says 172.21.15.153:55724) 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 -- 172.21.15.153:0/3513765696 learned_addr learned my addr 172.21.15.153:0/3513765696 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f719f400640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71a8072260 0x7f71a8158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71ad000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a815a420 0x7f71a81e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 -- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a815a420 msgr2=0x7f71a81e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a815a420 0x7f71a81e9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 -- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71a8072260 msgr2=0x7f71a8158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71a8072260 0x7f71a8158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.375+0000 7f71a7e00640 1 -- 172.21.15.153:0/3513765696 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a81f5c50 con 0x7f71a806cd90 2024-09-17T03:15:52.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71a7e00640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f719800c3d0 tx=0x7f719800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:52.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71980053c0 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a81f5f30 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198003850 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.376+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81f64f0 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.377+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a80751d0 con 0x7f71a806cd90 2024-09-17T03:15:52.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.378+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f719801a070 con 0x7f71a806cd90 2024-09-17T03:15:52.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.379+0000 7f71a4c00640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 0x7f718407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.379+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f719809a110 con 0x7f71a806cd90 2024-09-17T03:15:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.380+0000 7f719f400640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 0x7f718407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.380+0000 7f719f400640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 0x7f718407b0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7190033000 tx=0x7f7190004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:52.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.384+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71a806d6e0 con 0x7f71a806cd90 2024-09-17T03:15:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.567+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71a8159ba0 con 0x7f71a806cd90 2024-09-17T03:15:52.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.569+0000 7f71a4c00640 1 -- 172.21.15.153:0/3513765696 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16978 (secure 0 0 0) 0x7f7198061e90 con 0x7f71a806cd90 2024-09-17T03:15:52.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:52.568 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":58,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:15:49.616044+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:15:46.001140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:15:47.065591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:52.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 msgr2=0x7f718407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 0x7f718407b0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7190033000 tx=0x7f7190004730 comp rx=0 tx=0).stop 2024-09-17T03:15:52.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 msgr2=0x7f71a80d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f719800c3d0 tx=0x7f719800c890 comp rx=0 tx=0).stop 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 shutdown_connections 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7184078b90 0x7f718407b0a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71a815a420 0x7f71a81e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71a8072260 0x7f71a8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 --2- 172.21.15.153:0/3513765696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a806cd90 0x7f71a80d0950 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 >> 172.21.15.153:0/3513765696 conn(0x7f71a80b2d50 msgr2=0x7f71a815d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 shutdown_connections 2024-09-17T03:15:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.571+0000 7f71af000640 1 -- 172.21.15.153:0/3513765696 wait complete. 2024-09-17T03:15:52.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:15:52.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:52.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 -- 172.21.15.153:0/1456628750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904007550 msgr2=0x7f39040e3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 --2- 172.21.15.153:0/1456628750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904007550 0x7f39040e3200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009860 tx=0x7f38f802a530 comp rx=0 tx=0).stop 2024-09-17T03:15:52.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 -- 172.21.15.153:0/1456628750 shutdown_connections 2024-09-17T03:15:52.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 --2- 172.21.15.153:0/1456628750 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904007550 0x7f39040e3200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 -- 172.21.15.153:0/1456628750 >> 172.21.15.153:0/1456628750 conn(0x7f390403a680 msgr2=0x7f390403aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 -- 172.21.15.153:0/1456628750 shutdown_connections 2024-09-17T03:15:52.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.821+0000 7f3911c00640 1 -- 172.21.15.153:0/1456628750 wait complete. 2024-09-17T03:15:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.823+0000 7f3911c00640 1 Processor -- start 2024-09-17T03:15:52.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.823+0000 7f3911c00640 1 -- start start 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 0x7f3904031050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 0x7f3904031590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f390403cce0 con 0x7f3904007550 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f390403cb60 con 0x7f3904054190 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f390403ce60 con 0x7f3904053860 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55738/0 (socket says 172.21.15.153:55738) 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 -- 172.21.15.153:0/824255762 learned_addr learned my addr 172.21.15.153:0/824255762 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390b400640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 0x7f3904031050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911200640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 0x7f3904031590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 -- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 msgr2=0x7f3904031050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 0x7f3904031050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 -- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 msgr2=0x7f3904031590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 0x7f3904031590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390be00640 1 -- 172.21.15.153:0/824255762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3904030080 con 0x7f3904007550 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f390b400640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 0x7f3904031050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.825+0000 7f3911200640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 0x7f3904031590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f390be00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3900001220 tx=0x7f390000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900011790 con 0x7f3904007550 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39040e7710 con 0x7f3904007550 2024-09-17T03:15:52.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3900017070 con 0x7f3904007550 2024-09-17T03:15:52.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900011cc0 con 0x7f3904007550 2024-09-17T03:15:52.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.826+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39040e4c00 con 0x7f3904007550 2024-09-17T03:15:52.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.827+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39040e7c30 con 0x7f3904007550 2024-09-17T03:15:52.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.828+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f390001c460 con 0x7f3904007550 2024-09-17T03:15:52.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.829+0000 7f38ffe00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 0x7f38ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:52.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.830+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f390009ac90 con 0x7f3904007550 2024-09-17T03:15:52.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.830+0000 7f390b400640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 0x7f38ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:52.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.831+0000 7f390b400640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 0x7f38ec07b0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f38f8034000 tx=0x7f38f8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:52.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:52.834+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39040e7c30 con 0x7f3904007550 2024-09-17T03:15:52.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:52.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:53.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.021+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3904030360 con 0x7f38ec078bc0 2024-09-17T03:15:53.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.026+0000 7f38ffe00640 1 -- 172.21.15.153:0/824255762 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f3904030360 con 0x7f38ec078bc0 2024-09-17T03:15:53.029 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:53.031 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:15:53.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.030+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 msgr2=0x7f38ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.030+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 0x7f38ec07b0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f38f8034000 tx=0x7f38f8004730 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.030+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 msgr2=0x7f39040dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.030+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3900001220 tx=0x7f390000c890 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.030+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 shutdown_connections 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f38ec078bc0 0x7f38ec07b0d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3904054190 0x7f3904031590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3904053860 0x7f3904031050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 --2- 172.21.15.153:0/824255762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3904007550 0x7f39040dfff0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 >> 172.21.15.153:0/824255762 conn(0x7f390403a680 msgr2=0x7f3904051be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 shutdown_connections 2024-09-17T03:15:53.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.031+0000 7f3911c00640 1 -- 172.21.15.153:0/824255762 wait complete. 2024-09-17T03:15:53.051 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-17T03:15:52.854522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226980,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747740,"statfs":{"total":773094113280,"available":772861685760,"internally_reserved":0,"allocated":6713344,"data_stored":3640552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001593"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640132+0000","last_change":"2024-09-17T03:15:48.626565+0000","last_active":"2024-09-17T03:15:48.640132+0000","last_peered":"2024-09-17T03:15:48.640132+0000","last_clean":"2024-09-17T03:15:48.640132+0000","last_became_active":"2024-09-17T03:15:48.626198+0000","last_became_peered":"2024-09-17T03:15:48.626198+0000","last_unstale":"2024-09-17T03:15:48.640132+0000","last_undegraded":"2024-09-17T03:15:48.640132+0000","last_fullsized":"2024-09-17T03:15:48.640132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:01.791030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631615+0000","last_change":"2024-09-17T03:15:48.638730+0000","last_active":"2024-09-17T03:15:49.631615+0000","last_peered":"2024-09-17T03:15:49.631615+0000","last_clean":"2024-09-17T03:15:49.631615+0000","last_became_active":"2024-09-17T03:15:48.638410+0000","last_became_peered":"2024-09-17T03:15:48.638410+0000","last_unstale":"2024-09-17T03:15:49.631615+0000","last_undegraded":"2024-09-17T03:15:49.631615+0000","last_fullsized":"2024-09-17T03:15:49.631615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:40.677347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629752+0000","last_change":"2024-09-17T03:15:48.623546+0000","last_active":"2024-09-17T03:15:49.629752+0000","last_peered":"2024-09-17T03:15:49.629752+0000","last_clean":"2024-09-17T03:15:49.629752+0000","last_became_active":"2024-09-17T03:15:48.623250+0000","last_became_peered":"2024-09-17T03:15:48.623250+0000","last_unstale":"2024-09-17T03:15:49.629752+0000","last_undegraded":"2024-09-17T03:15:49.629752+0000","last_fullsized":"2024-09-17T03:15:49.629752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:13.086151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760410+0000","last_change":"2024-09-17T03:15:48.636711+0000","last_active":"2024-09-17T03:15:49.760410+0000","last_peered":"2024-09-17T03:15:49.760410+0000","last_clean":"2024-09-17T03:15:49.760410+0000","last_became_active":"2024-09-17T03:15:48.635391+0000","last_became_peered":"2024-09-17T03:15:48.635391+0000","last_unstale":"2024-09-17T03:15:49.760410+0000","last_undegraded":"2024-09-17T03:15:49.760410+0000","last_fullsized":"2024-09-17T03:15:49.760410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:53.037491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630981+0000","last_change":"2024-09-17T03:15:48.646594+0000","last_active":"2024-09-17T03:15:49.630981+0000","last_peered":"2024-09-17T03:15:49.630981+0000","last_clean":"2024-09-17T03:15:49.630981+0000","last_became_active":"2024-09-17T03:15:48.646047+0000","last_became_peered":"2024-09-17T03:15:48.646047+0000","last_unstale":"2024-09-17T03:15:49.630981+0000","last_undegraded":"2024-09-17T03:15:49.630981+0000","last_fullsized":"2024-09-17T03:15:49.630981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:47.885285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701856+0000","last_change":"2024-09-17T03:15:48.638342+0000","last_active":"2024-09-17T03:15:49.701856+0000","last_peered":"2024-09-17T03:15:49.701856+0000","last_clean":"2024-09-17T03:15:49.701856+0000","last_became_active":"2024-09-17T03:15:48.637004+0000","last_became_peered":"2024-09-17T03:15:48.637004+0000","last_unstale":"2024-09-17T03:15:49.701856+0000","last_undegraded":"2024-09-17T03:15:49.701856+0000","last_fullsized":"2024-09-17T03:15:49.701856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:26.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120219+0000","last_change":"2024-09-17T03:15:48.632240+0000","last_active":"2024-09-17T03:15:50.120219+0000","last_peered":"2024-09-17T03:15:50.120219+0000","last_clean":"2024-09-17T03:15:50.120219+0000","last_became_active":"2024-09-17T03:15:48.631898+0000","last_became_peered":"2024-09-17T03:15:48.631898+0000","last_unstale":"2024-09-17T03:15:50.120219+0000","last_undegraded":"2024-09-17T03:15:50.120219+0000","last_fullsized":"2024-09-17T03:15:50.120219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:45.843144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701734+0000","last_change":"2024-09-17T03:15:48.633015+0000","last_active":"2024-09-17T03:15:49.701734+0000","last_peered":"2024-09-17T03:15:49.701734+0000","last_clean":"2024-09-17T03:15:49.701734+0000","last_became_active":"2024-09-17T03:15:48.632719+0000","last_became_peered":"2024-09-17T03:15:48.632719+0000","last_unstale":"2024-09-17T03:15:49.701734+0000","last_undegraded":"2024-09-17T03:15:49.701734+0000","last_fullsized":"2024-09-17T03:15:49.701734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:39.909544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630449+0000","last_change":"2024-09-17T03:15:48.621423+0000","last_active":"2024-09-17T03:15:49.630449+0000","last_peered":"2024-09-17T03:15:49.630449+0000","last_clean":"2024-09-17T03:15:49.630449+0000","last_became_active":"2024-09-17T03:15:48.621103+0000","last_became_peered":"2024-09-17T03:15:48.621103+0000","last_unstale":"2024-09-17T03:15:49.630449+0000","last_undegraded":"2024-09-17T03:15:49.630449+0000","last_fullsized":"2024-09-17T03:15:49.630449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.163544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120695+0000","last_change":"2024-09-17T03:15:48.646614+0000","last_active":"2024-09-17T03:15:50.120695+0000","last_peered":"2024-09-17T03:15:50.120695+0000","last_clean":"2024-09-17T03:15:50.120695+0000","last_became_active":"2024-09-17T03:15:48.646259+0000","last_became_peered":"2024-09-17T03:15:48.646259+0000","last_unstale":"2024-09-17T03:15:50.120695+0000","last_undegraded":"2024-09-17T03:15:50.120695+0000","last_fullsized":"2024-09-17T03:15:50.120695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:26.740309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.633177+0000","last_change":"2024-09-17T03:15:48.624193+0000","last_active":"2024-09-17T03:15:48.633177+0000","last_peered":"2024-09-17T03:15:48.633177+0000","last_clean":"2024-09-17T03:15:48.633177+0000","last_became_active":"2024-09-17T03:15:48.623874+0000","last_became_peered":"2024-09-17T03:15:48.623874+0000","last_unstale":"2024-09-17T03:15:48.633177+0000","last_undegraded":"2024-09-17T03:15:48.633177+0000","last_fullsized":"2024-09-17T03:15:48.633177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:04.756500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701807+0000","last_change":"2024-09-17T03:15:48.642544+0000","last_active":"2024-09-17T03:15:49.701807+0000","last_peered":"2024-09-17T03:15:49.701807+0000","last_clean":"2024-09-17T03:15:49.701807+0000","last_became_active":"2024-09-17T03:15:48.642205+0000","last_became_peered":"2024-09-17T03:15:48.642205+0000","last_unstale":"2024-09-17T03:15:49.701807+0000","last_undegraded":"2024-09-17T03:15:49.701807+0000","last_fullsized":"2024-09-17T03:15:49.701807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:10.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702156+0000","last_change":"2024-09-17T03:15:48.644018+0000","last_active":"2024-09-17T03:15:49.702156+0000","last_peered":"2024-09-17T03:15:49.702156+0000","last_clean":"2024-09-17T03:15:49.702156+0000","last_became_active":"2024-09-17T03:15:48.640950+0000","last_became_peered":"2024-09-17T03:15:48.640950+0000","last_unstale":"2024-09-17T03:15:49.702156+0000","last_undegraded":"2024-09-17T03:15:49.702156+0000","last_fullsized":"2024-09-17T03:15:49.702156+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:23.322949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646740+0000","last_change":"2024-09-17T03:15:48.632849+0000","last_active":"2024-09-17T03:15:48.646740+0000","last_peered":"2024-09-17T03:15:48.646740+0000","last_clean":"2024-09-17T03:15:48.646740+0000","last_became_active":"2024-09-17T03:15:48.632526+0000","last_became_peered":"2024-09-17T03:15:48.632526+0000","last_unstale":"2024-09-17T03:15:48.646740+0000","last_undegraded":"2024-09-17T03:15:48.646740+0000","last_fullsized":"2024-09-17T03:15:48.646740+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:23.201935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760185+0000","last_change":"2024-09-17T03:15:48.625846+0000","last_active":"2024-09-17T03:15:49.760185+0000","last_peered":"2024-09-17T03:15:49.760185+0000","last_clean":"2024-09-17T03:15:49.760185+0000","last_became_active":"2024-09-17T03:15:48.625475+0000","last_became_peered":"2024-09-17T03:15:48.625475+0000","last_unstale":"2024-09-17T03:15:49.760185+0000","last_undegraded":"2024-09-17T03:15:49.760185+0000","last_fullsized":"2024-09-17T03:15:49.760185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:13.465251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701789+0000","last_change":"2024-09-17T03:15:48.623026+0000","last_active":"2024-09-17T03:15:49.701789+0000","last_peered":"2024-09-17T03:15:49.701789+0000","last_clean":"2024-09-17T03:15:49.701789+0000","last_became_active":"2024-09-17T03:15:48.622654+0000","last_became_peered":"2024-09-17T03:15:48.622654+0000","last_unstale":"2024-09-17T03:15:49.701789+0000","last_undegraded":"2024-09-17T03:15:49.701789+0000","last_fullsized":"2024-09-17T03:15:49.701789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:01.612794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640161+0000","last_change":"2024-09-17T03:15:48.626656+0000","last_active":"2024-09-17T03:15:48.640161+0000","last_peered":"2024-09-17T03:15:48.640161+0000","last_clean":"2024-09-17T03:15:48.640161+0000","last_became_active":"2024-09-17T03:15:48.625464+0000","last_became_peered":"2024-09-17T03:15:48.625464+0000","last_unstale":"2024-09-17T03:15:48.640161+0000","last_undegraded":"2024-09-17T03:15:48.640161+0000","last_fullsized":"2024-09-17T03:15:48.640161+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:34.179629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760563+0000","last_change":"2024-09-17T03:15:48.634840+0000","last_active":"2024-09-17T03:15:49.760563+0000","last_peered":"2024-09-17T03:15:49.760563+0000","last_clean":"2024-09-17T03:15:49.760563+0000","last_became_active":"2024-09-17T03:15:48.634561+0000","last_became_peered":"2024-09-17T03:15:48.634561+0000","last_unstale":"2024-09-17T03:15:49.760563+0000","last_undegraded":"2024-09-17T03:15:49.760563+0000","last_fullsized":"2024-09-17T03:15:49.760563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:02.971081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629995+0000","last_change":"2024-09-17T03:15:48.639087+0000","last_active":"2024-09-17T03:15:49.629995+0000","last_peered":"2024-09-17T03:15:49.629995+0000","last_clean":"2024-09-17T03:15:49.629995+0000","last_became_active":"2024-09-17T03:15:48.637509+0000","last_became_peered":"2024-09-17T03:15:48.637509+0000","last_unstale":"2024-09-17T03:15:49.629995+0000","last_undegraded":"2024-09-17T03:15:49.629995+0000","last_fullsized":"2024-09-17T03:15:49.629995+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:21.103079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631255+0000","last_change":"2024-09-17T03:15:48.641863+0000","last_active":"2024-09-17T03:15:49.631255+0000","last_peered":"2024-09-17T03:15:49.631255+0000","last_clean":"2024-09-17T03:15:49.631255+0000","last_became_active":"2024-09-17T03:15:48.638778+0000","last_became_peered":"2024-09-17T03:15:48.638778+0000","last_unstale":"2024-09-17T03:15:49.631255+0000","last_undegraded":"2024-09-17T03:15:49.631255+0000","last_fullsized":"2024-09-17T03:15:49.631255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:23.322949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760220+0000","last_change":"2024-09-17T03:15:48.628962+0000","last_active":"2024-09-17T03:15:49.760220+0000","last_peered":"2024-09-17T03:15:49.760220+0000","last_clean":"2024-09-17T03:15:49.760220+0000","last_became_active":"2024-09-17T03:15:48.628675+0000","last_became_peered":"2024-09-17T03:15:48.628675+0000","last_unstale":"2024-09-17T03:15:49.760220+0000","last_undegraded":"2024-09-17T03:15:49.760220+0000","last_fullsized":"2024-09-17T03:15:49.760220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:45.357011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629086+0000","last_change":"2024-09-17T03:15:48.631924+0000","last_active":"2024-09-17T03:15:49.629086+0000","last_peered":"2024-09-17T03:15:49.629086+0000","last_clean":"2024-09-17T03:15:49.629086+0000","last_became_active":"2024-09-17T03:15:48.628269+0000","last_became_peered":"2024-09-17T03:15:48.628269+0000","last_unstale":"2024-09-17T03:15:49.629086+0000","last_undegraded":"2024-09-17T03:15:49.629086+0000","last_fullsized":"2024-09-17T03:15:49.629086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:20.099988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628696+0000","last_change":"2024-09-17T03:15:48.631326+0000","last_active":"2024-09-17T03:15:49.628696+0000","last_peered":"2024-09-17T03:15:49.628696+0000","last_clean":"2024-09-17T03:15:49.628696+0000","last_became_active":"2024-09-17T03:15:48.626998+0000","last_became_peered":"2024-09-17T03:15:48.626998+0000","last_unstale":"2024-09-17T03:15:49.628696+0000","last_undegraded":"2024-09-17T03:15:49.628696+0000","last_fullsized":"2024-09-17T03:15:49.628696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:12.079223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628745+0000","last_change":"2024-09-17T03:15:48.632275+0000","last_active":"2024-09-17T03:15:49.628745+0000","last_peered":"2024-09-17T03:15:49.628745+0000","last_clean":"2024-09-17T03:15:49.628745+0000","last_became_active":"2024-09-17T03:15:48.631991+0000","last_became_peered":"2024-09-17T03:15:48.631991+0000","last_unstale":"2024-09-17T03:15:49.628745+0000","last_undegraded":"2024-09-17T03:15:49.628745+0000","last_fullsized":"2024-09-17T03:15:49.628745+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:16.285113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640517+0000","last_change":"2024-09-17T03:15:48.630609+0000","last_active":"2024-09-17T03:15:48.640517+0000","last_peered":"2024-09-17T03:15:48.640517+0000","last_clean":"2024-09-17T03:15:48.640517+0000","last_became_active":"2024-09-17T03:15:48.630237+0000","last_became_peered":"2024-09-17T03:15:48.630237+0000","last_unstale":"2024-09-17T03:15:48.640517+0000","last_undegraded":"2024-09-17T03:15:48.640517+0000","last_fullsized":"2024-09-17T03:15:48.640517+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:08.738098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630020+0000","last_change":"2024-09-17T03:15:48.620122+0000","last_active":"2024-09-17T03:15:49.630020+0000","last_peered":"2024-09-17T03:15:49.630020+0000","last_clean":"2024-09-17T03:15:49.630020+0000","last_became_active":"2024-09-17T03:15:48.619712+0000","last_became_peered":"2024-09-17T03:15:48.619712+0000","last_unstale":"2024-09-17T03:15:49.630020+0000","last_undegraded":"2024-09-17T03:15:49.630020+0000","last_fullsized":"2024-09-17T03:15:49.630020+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:55.359196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702010+0000","last_change":"2024-09-17T03:15:48.643453+0000","last_active":"2024-09-17T03:15:49.702010+0000","last_peered":"2024-09-17T03:15:49.702010+0000","last_clean":"2024-09-17T03:15:49.702010+0000","last_became_active":"2024-09-17T03:15:48.643154+0000","last_became_peered":"2024-09-17T03:15:48.643154+0000","last_unstale":"2024-09-17T03:15:49.702010+0000","last_undegraded":"2024-09-17T03:15:49.702010+0000","last_fullsized":"2024-09-17T03:15:49.702010+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:47.885285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631284+0000","last_change":"2024-09-17T03:15:48.646408+0000","last_active":"2024-09-17T03:15:49.631284+0000","last_peered":"2024-09-17T03:15:49.631284+0000","last_clean":"2024-09-17T03:15:49.631284+0000","last_became_active":"2024-09-17T03:15:48.646074+0000","last_became_peered":"2024-09-17T03:15:48.646074+0000","last_unstale":"2024-09-17T03:15:49.631284+0000","last_undegraded":"2024-09-17T03:15:49.631284+0000","last_fullsized":"2024-09-17T03:15:49.631284+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.813853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646684+0000","last_change":"2024-09-17T03:15:48.637323+0000","last_active":"2024-09-17T03:15:48.646684+0000","last_peered":"2024-09-17T03:15:48.646684+0000","last_clean":"2024-09-17T03:15:48.646684+0000","last_became_active":"2024-09-17T03:15:48.636145+0000","last_became_peered":"2024-09-17T03:15:48.636145+0000","last_unstale":"2024-09-17T03:15:48.646684+0000","last_undegraded":"2024-09-17T03:15:48.646684+0000","last_fullsized":"2024-09-17T03:15:48.646684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:03.409428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120082+0000","last_change":"2024-09-17T03:15:48.640751+0000","last_active":"2024-09-17T03:15:50.120082+0000","last_peered":"2024-09-17T03:15:50.120082+0000","last_clean":"2024-09-17T03:15:50.120082+0000","last_became_active":"2024-09-17T03:15:48.640416+0000","last_became_peered":"2024-09-17T03:15:48.640416+0000","last_unstale":"2024-09-17T03:15:50.120082+0000","last_undegraded":"2024-09-17T03:15:50.120082+0000","last_fullsized":"2024-09-17T03:15:50.120082+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:50.068343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628955+0000","last_change":"2024-09-17T03:15:48.631624+0000","last_active":"2024-09-17T03:15:49.628955+0000","last_peered":"2024-09-17T03:15:49.628955+0000","last_clean":"2024-09-17T03:15:49.628955+0000","last_became_active":"2024-09-17T03:15:48.627380+0000","last_became_peered":"2024-09-17T03:15:48.627380+0000","last_unstale":"2024-09-17T03:15:49.628955+0000","last_undegraded":"2024-09-17T03:15:49.628955+0000","last_fullsized":"2024-09-17T03:15:49.628955+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:00.295733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630602+0000","last_change":"2024-09-17T03:15:48.621553+0000","last_active":"2024-09-17T03:15:49.630602+0000","last_peered":"2024-09-17T03:15:49.630602+0000","last_clean":"2024-09-17T03:15:49.630602+0000","last_became_active":"2024-09-17T03:15:48.621232+0000","last_became_peered":"2024-09-17T03:15:48.621232+0000","last_unstale":"2024-09-17T03:15:49.630602+0000","last_undegraded":"2024-09-17T03:15:49.630602+0000","last_fullsized":"2024-09-17T03:15:49.630602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:44.384503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120160+0000","last_change":"2024-09-17T03:15:48.641997+0000","last_active":"2024-09-17T03:15:50.120160+0000","last_peered":"2024-09-17T03:15:50.120160+0000","last_clean":"2024-09-17T03:15:50.120160+0000","last_became_active":"2024-09-17T03:15:48.641607+0000","last_became_peered":"2024-09-17T03:15:48.641607+0000","last_unstale":"2024-09-17T03:15:50.120160+0000","last_undegraded":"2024-09-17T03:15:50.120160+0000","last_fullsized":"2024-09-17T03:15:50.120160+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:54.682775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777313+0000","last_change":"2024-09-17T03:15:47.626799+0000","last_active":"2024-09-17T03:15:49.777313+0000","last_peered":"2024-09-17T03:15:49.777313+0000","last_clean":"2024-09-17T03:15:49.777313+0000","last_became_active":"2024-09-17T03:15:47.626492+0000","last_became_peered":"2024-09-17T03:15:47.626492+0000","last_unstale":"2024-09-17T03:15:49.777313+0000","last_undegraded":"2024-09-17T03:15:49.777313+0000","last_fullsized":"2024-09-17T03:15:49.777313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:08.754255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.119944+0000","last_change":"2024-09-17T03:15:48.638690+0000","last_active":"2024-09-17T03:15:50.119944+0000","last_peered":"2024-09-17T03:15:50.119944+0000","last_clean":"2024-09-17T03:15:50.119944+0000","last_became_active":"2024-09-17T03:15:48.638355+0000","last_became_peered":"2024-09-17T03:15:48.638355+0000","last_unstale":"2024-09-17T03:15:50.119944+0000","last_undegraded":"2024-09-17T03:15:50.119944+0000","last_fullsized":"2024-09-17T03:15:50.119944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:31.132948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702110+0000","last_change":"2024-09-17T03:15:47.632513+0000","last_active":"2024-09-17T03:15:49.702110+0000","last_peered":"2024-09-17T03:15:49.702110+0000","last_clean":"2024-09-17T03:15:49.702110+0000","last_became_active":"2024-09-17T03:15:47.631966+0000","last_became_peered":"2024-09-17T03:15:47.631966+0000","last_unstale":"2024-09-17T03:15:49.702110+0000","last_undegraded":"2024-09-17T03:15:49.702110+0000","last_fullsized":"2024-09-17T03:15:49.702110+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:13.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120087+0000","last_change":"2024-09-17T03:15:48.643546+0000","last_active":"2024-09-17T03:15:50.120087+0000","last_peered":"2024-09-17T03:15:50.120087+0000","last_clean":"2024-09-17T03:15:50.120087+0000","last_became_active":"2024-09-17T03:15:48.642921+0000","last_became_peered":"2024-09-17T03:15:48.642921+0000","last_unstale":"2024-09-17T03:15:50.120087+0000","last_undegraded":"2024-09-17T03:15:50.120087+0000","last_fullsized":"2024-09-17T03:15:50.120087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:33.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120592+0000","last_change":"2024-09-17T03:15:47.627161+0000","last_active":"2024-09-17T03:15:50.120592+0000","last_peered":"2024-09-17T03:15:50.120592+0000","last_clean":"2024-09-17T03:15:50.120592+0000","last_became_active":"2024-09-17T03:15:47.625250+0000","last_became_peered":"2024-09-17T03:15:47.625250+0000","last_unstale":"2024-09-17T03:15:50.120592+0000","last_undegraded":"2024-09-17T03:15:50.120592+0000","last_fullsized":"2024-09-17T03:15:50.120592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:03.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120308+0000","last_change":"2024-09-17T03:15:48.641354+0000","last_active":"2024-09-17T03:15:50.120308+0000","last_peered":"2024-09-17T03:15:50.120308+0000","last_clean":"2024-09-17T03:15:50.120308+0000","last_became_active":"2024-09-17T03:15:48.641025+0000","last_became_peered":"2024-09-17T03:15:48.641025+0000","last_unstale":"2024-09-17T03:15:50.120308+0000","last_undegraded":"2024-09-17T03:15:50.120308+0000","last_fullsized":"2024-09-17T03:15:50.120308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:07.829496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631425+0000","last_change":"2024-09-17T03:15:47.621974+0000","last_active":"2024-09-17T03:15:49.631425+0000","last_peered":"2024-09-17T03:15:49.631425+0000","last_clean":"2024-09-17T03:15:49.631425+0000","last_became_active":"2024-09-17T03:15:47.621567+0000","last_became_peered":"2024-09-17T03:15:47.621567+0000","last_unstale":"2024-09-17T03:15:49.631425+0000","last_undegraded":"2024-09-17T03:15:49.631425+0000","last_fullsized":"2024-09-17T03:15:49.631425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:59.335584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777252+0000","last_change":"2024-09-17T03:15:48.639078+0000","last_active":"2024-09-17T03:15:49.777252+0000","last_peered":"2024-09-17T03:15:49.777252+0000","last_clean":"2024-09-17T03:15:49.777252+0000","last_became_active":"2024-09-17T03:15:48.638719+0000","last_became_peered":"2024-09-17T03:15:48.638719+0000","last_unstale":"2024-09-17T03:15:49.777252+0000","last_undegraded":"2024-09-17T03:15:49.777252+0000","last_fullsized":"2024-09-17T03:15:49.777252+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:54.621130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630607+0000","last_change":"2024-09-17T03:15:47.628446+0000","last_active":"2024-09-17T03:15:49.630607+0000","last_peered":"2024-09-17T03:15:49.630607+0000","last_clean":"2024-09-17T03:15:49.630607+0000","last_became_active":"2024-09-17T03:15:47.626028+0000","last_became_peered":"2024-09-17T03:15:47.626028+0000","last_unstale":"2024-09-17T03:15:49.630607+0000","last_undegraded":"2024-09-17T03:15:49.630607+0000","last_fullsized":"2024-09-17T03:15:49.630607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:19.374903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120106+0000","last_change":"2024-09-17T03:15:48.643456+0000","last_active":"2024-09-17T03:15:50.120106+0000","last_peered":"2024-09-17T03:15:50.120106+0000","last_clean":"2024-09-17T03:15:50.120106+0000","last_became_active":"2024-09-17T03:15:48.643184+0000","last_became_peered":"2024-09-17T03:15:48.643184+0000","last_unstale":"2024-09-17T03:15:50.120106+0000","last_undegraded":"2024-09-17T03:15:50.120106+0000","last_fullsized":"2024-09-17T03:15:50.120106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:21.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120222+0000","last_change":"2024-09-17T03:15:47.625119+0000","last_active":"2024-09-17T03:15:50.120222+0000","last_peered":"2024-09-17T03:15:50.120222+0000","last_clean":"2024-09-17T03:15:50.120222+0000","last_became_active":"2024-09-17T03:15:47.624727+0000","last_became_peered":"2024-09-17T03:15:47.624727+0000","last_unstale":"2024-09-17T03:15:50.120222+0000","last_undegraded":"2024-09-17T03:15:50.120222+0000","last_fullsized":"2024-09-17T03:15:50.120222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:11.076444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120645+0000","last_change":"2024-09-17T03:15:48.644886+0000","last_active":"2024-09-17T03:15:50.120645+0000","last_peered":"2024-09-17T03:15:50.120645+0000","last_clean":"2024-09-17T03:15:50.120645+0000","last_became_active":"2024-09-17T03:15:48.643453+0000","last_became_peered":"2024-09-17T03:15:48.643453+0000","last_unstale":"2024-09-17T03:15:50.120645+0000","last_undegraded":"2024-09-17T03:15:50.120645+0000","last_fullsized":"2024-09-17T03:15:50.120645+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:17.649319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.119880+0000","last_change":"2024-09-17T03:15:47.626469+0000","last_active":"2024-09-17T03:15:50.119880+0000","last_peered":"2024-09-17T03:15:50.119880+0000","last_clean":"2024-09-17T03:15:50.119880+0000","last_became_active":"2024-09-17T03:15:47.626128+0000","last_became_peered":"2024-09-17T03:15:47.626128+0000","last_unstale":"2024-09-17T03:15:50.119880+0000","last_undegraded":"2024-09-17T03:15:50.119880+0000","last_fullsized":"2024-09-17T03:15:50.119880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:36.897288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760629+0000","last_change":"2024-09-17T03:15:48.634089+0000","last_active":"2024-09-17T03:15:49.760629+0000","last_peered":"2024-09-17T03:15:49.760629+0000","last_clean":"2024-09-17T03:15:49.760629+0000","last_became_active":"2024-09-17T03:15:48.633770+0000","last_became_peered":"2024-09-17T03:15:48.633770+0000","last_unstale":"2024-09-17T03:15:49.760629+0000","last_undegraded":"2024-09-17T03:15:49.760629+0000","last_fullsized":"2024-09-17T03:15:49.760629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:47.819332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629528+0000","last_change":"2024-09-17T03:15:47.625533+0000","last_active":"2024-09-17T03:15:49.629528+0000","last_peered":"2024-09-17T03:15:49.629528+0000","last_clean":"2024-09-17T03:15:49.629528+0000","last_became_active":"2024-09-17T03:15:47.624712+0000","last_became_peered":"2024-09-17T03:15:47.624712+0000","last_unstale":"2024-09-17T03:15:49.629528+0000","last_undegraded":"2024-09-17T03:15:49.629528+0000","last_fullsized":"2024-09-17T03:15:49.629528+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.291174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.776968+0000","last_change":"2024-09-17T03:15:48.623686+0000","last_active":"2024-09-17T03:15:49.776968+0000","last_peered":"2024-09-17T03:15:49.776968+0000","last_clean":"2024-09-17T03:15:49.776968+0000","last_became_active":"2024-09-17T03:15:48.623325+0000","last_became_peered":"2024-09-17T03:15:48.623325+0000","last_unstale":"2024-09-17T03:15:49.776968+0000","last_undegraded":"2024-09-17T03:15:49.776968+0000","last_fullsized":"2024-09-17T03:15:49.776968+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:58.755965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760636+0000","last_change":"2024-09-17T03:15:47.619590+0000","last_active":"2024-09-17T03:15:49.760636+0000","last_peered":"2024-09-17T03:15:49.760636+0000","last_clean":"2024-09-17T03:15:49.760636+0000","last_became_active":"2024-09-17T03:15:47.619278+0000","last_became_peered":"2024-09-17T03:15:47.619278+0000","last_unstale":"2024-09-17T03:15:49.760636+0000","last_undegraded":"2024-09-17T03:15:49.760636+0000","last_fullsized":"2024-09-17T03:15:49.760636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:24.514537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760209+0000","last_change":"2024-09-17T03:15:48.637670+0000","last_active":"2024-09-17T03:15:49.760209+0000","last_peered":"2024-09-17T03:15:49.760209+0000","last_clean":"2024-09-17T03:15:49.760209+0000","last_became_active":"2024-09-17T03:15:48.637374+0000","last_became_peered":"2024-09-17T03:15:48.637374+0000","last_unstale":"2024-09-17T03:15:49.760209+0000","last_undegraded":"2024-09-17T03:15:49.760209+0000","last_fullsized":"2024-09-17T03:15:49.760209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:34.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760523+0000","last_change":"2024-09-17T03:15:47.621140+0000","last_active":"2024-09-17T03:15:49.760523+0000","last_peered":"2024-09-17T03:15:49.760523+0000","last_clean":"2024-09-17T03:15:49.760523+0000","last_became_active":"2024-09-17T03:15:47.620773+0000","last_became_peered":"2024-09-17T03:15:47.620773+0000","last_unstale":"2024-09-17T03:15:49.760523+0000","last_undegraded":"2024-09-17T03:15:49.760523+0000","last_fullsized":"2024-09-17T03:15:49.760523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:00.275162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646774+0000","last_change":"2024-09-17T03:15:48.638826+0000","last_active":"2024-09-17T03:15:48.646774+0000","last_peered":"2024-09-17T03:15:48.646774+0000","last_clean":"2024-09-17T03:15:48.646774+0000","last_became_active":"2024-09-17T03:15:48.638506+0000","last_became_peered":"2024-09-17T03:15:48.638506+0000","last_unstale":"2024-09-17T03:15:48.646774+0000","last_undegraded":"2024-09-17T03:15:48.646774+0000","last_fullsized":"2024-09-17T03:15:48.646774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:06.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120091+0000","last_change":"2024-09-17T03:15:47.625546+0000","last_active":"2024-09-17T03:15:50.120091+0000","last_peered":"2024-09-17T03:15:50.120091+0000","last_clean":"2024-09-17T03:15:50.120091+0000","last_became_active":"2024-09-17T03:15:47.625229+0000","last_became_peered":"2024-09-17T03:15:47.625229+0000","last_unstale":"2024-09-17T03:15:50.120091+0000","last_undegraded":"2024-09-17T03:15:50.120091+0000","last_fullsized":"2024-09-17T03:15:50.120091+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:15.282334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630989+0000","last_change":"2024-09-17T03:15:48.628048+0000","last_active":"2024-09-17T03:15:49.630989+0000","last_peered":"2024-09-17T03:15:49.630989+0000","last_clean":"2024-09-17T03:15:49.630989+0000","last_became_active":"2024-09-17T03:15:48.627505+0000","last_became_peered":"2024-09-17T03:15:48.627505+0000","last_unstale":"2024-09-17T03:15:49.630989+0000","last_undegraded":"2024-09-17T03:15:49.630989+0000","last_fullsized":"2024-09-17T03:15:49.630989+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.968414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120690+0000","last_change":"2024-09-17T03:15:47.632651+0000","last_active":"2024-09-17T03:15:50.120690+0000","last_peered":"2024-09-17T03:15:50.120690+0000","last_clean":"2024-09-17T03:15:50.120690+0000","last_became_active":"2024-09-17T03:15:47.632018+0000","last_became_peered":"2024-09-17T03:15:47.632018+0000","last_unstale":"2024-09-17T03:15:50.120690+0000","last_undegraded":"2024-09-17T03:15:50.120690+0000","last_fullsized":"2024-09-17T03:15:50.120690+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.844230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120177+0000","last_change":"2024-09-17T03:15:48.650067+0000","last_active":"2024-09-17T03:15:50.120177+0000","last_peered":"2024-09-17T03:15:50.120177+0000","last_clean":"2024-09-17T03:15:50.120177+0000","last_became_active":"2024-09-17T03:15:48.649721+0000","last_became_peered":"2024-09-17T03:15:48.649721+0000","last_unstale":"2024-09-17T03:15:50.120177+0000","last_undegraded":"2024-09-17T03:15:50.120177+0000","last_fullsized":"2024-09-17T03:15:50.120177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:00.510051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702017+0000","last_change":"2024-09-17T03:15:47.630879+0000","last_active":"2024-09-17T03:15:49.702017+0000","last_peered":"2024-09-17T03:15:49.702017+0000","last_clean":"2024-09-17T03:15:49.702017+0000","last_became_active":"2024-09-17T03:15:47.630499+0000","last_became_peered":"2024-09-17T03:15:47.630499+0000","last_unstale":"2024-09-17T03:15:49.702017+0000","last_undegraded":"2024-09-17T03:15:49.702017+0000","last_fullsized":"2024-09-17T03:15:49.702017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:04.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.641460+0000","last_change":"2024-09-17T03:15:48.630167+0000","last_active":"2024-09-17T03:15:48.641460+0000","last_peered":"2024-09-17T03:15:48.641460+0000","last_clean":"2024-09-17T03:15:48.641460+0000","last_became_active":"2024-09-17T03:15:48.629777+0000","last_became_peered":"2024-09-17T03:15:48.629777+0000","last_unstale":"2024-09-17T03:15:48.641460+0000","last_undegraded":"2024-09-17T03:15:48.641460+0000","last_fullsized":"2024-09-17T03:15:48.641460+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:17.672023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760611+0000","last_change":"2024-09-17T03:15:47.627918+0000","last_active":"2024-09-17T03:15:49.760611+0000","last_peered":"2024-09-17T03:15:49.760611+0000","last_clean":"2024-09-17T03:15:49.760611+0000","last_became_active":"2024-09-17T03:15:47.627642+0000","last_became_peered":"2024-09-17T03:15:47.627642+0000","last_unstale":"2024-09-17T03:15:49.760611+0000","last_undegraded":"2024-09-17T03:15:49.760611+0000","last_fullsized":"2024-09-17T03:15:49.760611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:46.798908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702332+0000","last_change":"2024-09-17T03:15:48.647163+0000","last_active":"2024-09-17T03:15:49.702332+0000","last_peered":"2024-09-17T03:15:49.702332+0000","last_clean":"2024-09-17T03:15:49.702332+0000","last_became_active":"2024-09-17T03:15:48.646195+0000","last_became_peered":"2024-09-17T03:15:48.646195+0000","last_unstale":"2024-09-17T03:15:49.702332+0000","last_undegraded":"2024-09-17T03:15:49.702332+0000","last_fullsized":"2024-09-17T03:15:49.702332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.813853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630611+0000","last_change":"2024-09-17T03:15:47.618905+0000","last_active":"2024-09-17T03:15:49.630611+0000","last_peered":"2024-09-17T03:15:49.630611+0000","last_clean":"2024-09-17T03:15:49.630611+0000","last_became_active":"2024-09-17T03:15:47.618618+0000","last_became_peered":"2024-09-17T03:15:47.618618+0000","last_unstale":"2024-09-17T03:15:49.630611+0000","last_undegraded":"2024-09-17T03:15:49.630611+0000","last_fullsized":"2024-09-17T03:15:49.630611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:03.055919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630531+0000","last_change":"2024-09-17T03:15:48.623750+0000","last_active":"2024-09-17T03:15:49.630531+0000","last_peered":"2024-09-17T03:15:49.630531+0000","last_clean":"2024-09-17T03:15:49.630531+0000","last_became_active":"2024-09-17T03:15:48.623197+0000","last_became_peered":"2024-09-17T03:15:48.623197+0000","last_unstale":"2024-09-17T03:15:49.630531+0000","last_undegraded":"2024-09-17T03:15:49.630531+0000","last_fullsized":"2024-09-17T03:15:49.630531+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:49.464778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701872+0000","last_change":"2024-09-17T03:15:47.632104+0000","last_active":"2024-09-17T03:15:49.701872+0000","last_peered":"2024-09-17T03:15:49.701872+0000","last_clean":"2024-09-17T03:15:49.701872+0000","last_became_active":"2024-09-17T03:15:47.631772+0000","last_became_peered":"2024-09-17T03:15:47.631772+0000","last_unstale":"2024-09-17T03:15:49.701872+0000","last_undegraded":"2024-09-17T03:15:49.701872+0000","last_fullsized":"2024-09-17T03:15:49.701872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.151080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120229+0000","last_change":"2024-09-17T03:15:48.645669+0000","last_active":"2024-09-17T03:15:50.120229+0000","last_peered":"2024-09-17T03:15:50.120229+0000","last_clean":"2024-09-17T03:15:50.120229+0000","last_became_active":"2024-09-17T03:15:48.645297+0000","last_became_peered":"2024-09-17T03:15:48.645297+0000","last_unstale":"2024-09-17T03:15:50.120229+0000","last_undegraded":"2024-09-17T03:15:50.120229+0000","last_fullsized":"2024-09-17T03:15:50.120229+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:09.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702238+0000","last_change":"2024-09-17T03:15:47.632270+0000","last_active":"2024-09-17T03:15:49.702238+0000","last_peered":"2024-09-17T03:15:49.702238+0000","last_clean":"2024-09-17T03:15:49.702238+0000","last_became_active":"2024-09-17T03:15:47.631980+0000","last_became_peered":"2024-09-17T03:15:47.631980+0000","last_unstale":"2024-09-17T03:15:49.702238+0000","last_undegraded":"2024-09-17T03:15:49.702238+0000","last_fullsized":"2024-09-17T03:15:49.702238+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:02.943928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.626512+0000","last_change":"2024-09-17T03:15:48.617733+0000","last_active":"2024-09-17T03:15:48.626512+0000","last_peered":"2024-09-17T03:15:48.626512+0000","last_clean":"2024-09-17T03:15:48.626512+0000","last_became_active":"2024-09-17T03:15:48.617381+0000","last_became_peered":"2024-09-17T03:15:48.617381+0000","last_unstale":"2024-09-17T03:15:48.626512+0000","last_undegraded":"2024-09-17T03:15:48.626512+0000","last_fullsized":"2024-09-17T03:15:48.626512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:17.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702195+0000","last_change":"2024-09-17T03:15:47.630874+0000","last_active":"2024-09-17T03:15:49.702195+0000","last_peered":"2024-09-17T03:15:49.702195+0000","last_clean":"2024-09-17T03:15:49.702195+0000","last_became_active":"2024-09-17T03:15:47.630454+0000","last_became_peered":"2024-09-17T03:15:47.630454+0000","last_unstale":"2024-09-17T03:15:49.702195+0000","last_undegraded":"2024-09-17T03:15:49.702195+0000","last_fullsized":"2024-09-17T03:15:49.702195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:12.130976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630777+0000","last_change":"2024-09-17T03:15:48.652116+0000","last_active":"2024-09-17T03:15:49.630777+0000","last_peered":"2024-09-17T03:15:49.630777+0000","last_clean":"2024-09-17T03:15:49.630777+0000","last_became_active":"2024-09-17T03:15:48.651827+0000","last_became_peered":"2024-09-17T03:15:48.651827+0000","last_unstale":"2024-09-17T03:15:49.630777+0000","last_undegraded":"2024-09-17T03:15:49.630777+0000","last_fullsized":"2024-09-17T03:15:49.630777+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:26.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760327+0000","last_change":"2024-09-17T03:15:47.626965+0000","last_active":"2024-09-17T03:15:49.760327+0000","last_peered":"2024-09-17T03:15:49.760327+0000","last_clean":"2024-09-17T03:15:49.760327+0000","last_became_active":"2024-09-17T03:15:47.626646+0000","last_became_peered":"2024-09-17T03:15:47.626646+0000","last_unstale":"2024-09-17T03:15:49.760327+0000","last_undegraded":"2024-09-17T03:15:49.760327+0000","last_fullsized":"2024-09-17T03:15:49.760327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:54.273982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701823+0000","last_change":"2024-09-17T03:15:48.644810+0000","last_active":"2024-09-17T03:15:49.701823+0000","last_peered":"2024-09-17T03:15:49.701823+0000","last_clean":"2024-09-17T03:15:49.701823+0000","last_became_active":"2024-09-17T03:15:48.644525+0000","last_became_peered":"2024-09-17T03:15:48.644525+0000","last_unstale":"2024-09-17T03:15:49.701823+0000","last_undegraded":"2024-09-17T03:15:49.701823+0000","last_fullsized":"2024-09-17T03:15:49.701823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631542+0000","last_change":"2024-09-17T03:15:47.623656+0000","last_active":"2024-09-17T03:15:49.631542+0000","last_peered":"2024-09-17T03:15:49.631542+0000","last_clean":"2024-09-17T03:15:49.631542+0000","last_became_active":"2024-09-17T03:15:47.623315+0000","last_became_peered":"2024-09-17T03:15:47.623315+0000","last_unstale":"2024-09-17T03:15:49.631542+0000","last_undegraded":"2024-09-17T03:15:49.631542+0000","last_fullsized":"2024-09-17T03:15:49.631542+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:44.921511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631471+0000","last_change":"2024-09-17T03:15:48.646431+0000","last_active":"2024-09-17T03:15:49.631471+0000","last_peered":"2024-09-17T03:15:49.631471+0000","last_clean":"2024-09-17T03:15:49.631471+0000","last_became_active":"2024-09-17T03:15:48.646156+0000","last_became_peered":"2024-09-17T03:15:48.646156+0000","last_unstale":"2024-09-17T03:15:49.631471+0000","last_undegraded":"2024-09-17T03:15:49.631471+0000","last_fullsized":"2024-09-17T03:15:49.631471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:22.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.641859+0000","last_change":"2024-09-17T03:15:47.628349+0000","last_active":"2024-09-17T03:15:48.641859+0000","last_peered":"2024-09-17T03:15:48.641859+0000","last_clean":"2024-09-17T03:15:48.641859+0000","last_became_active":"2024-09-17T03:15:47.628005+0000","last_became_peered":"2024-09-17T03:15:47.628005+0000","last_unstale":"2024-09-17T03:15:48.641859+0000","last_undegraded":"2024-09-17T03:15:48.641859+0000","last_fullsized":"2024-09-17T03:15:48.641859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:19.315776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760445+0000","last_change":"2024-09-17T03:15:48.630636+0000","last_active":"2024-09-17T03:15:49.760445+0000","last_peered":"2024-09-17T03:15:49.760445+0000","last_clean":"2024-09-17T03:15:49.760445+0000","last_became_active":"2024-09-17T03:15:48.630384+0000","last_became_peered":"2024-09-17T03:15:48.630384+0000","last_unstale":"2024-09-17T03:15:49.760445+0000","last_undegraded":"2024-09-17T03:15:49.760445+0000","last_fullsized":"2024-09-17T03:15:49.760445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:33.632359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630117+0000","last_change":"2024-09-17T03:15:47.626570+0000","last_active":"2024-09-17T03:15:49.630117+0000","last_peered":"2024-09-17T03:15:49.630117+0000","last_clean":"2024-09-17T03:15:49.630117+0000","last_became_active":"2024-09-17T03:15:47.626273+0000","last_became_peered":"2024-09-17T03:15:47.626273+0000","last_unstale":"2024-09-17T03:15:49.630117+0000","last_undegraded":"2024-09-17T03:15:49.630117+0000","last_fullsized":"2024-09-17T03:15:49.630117+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:48.187307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646863+0000","last_change":"2024-09-17T03:15:48.638592+0000","last_active":"2024-09-17T03:15:48.646863+0000","last_peered":"2024-09-17T03:15:48.646863+0000","last_clean":"2024-09-17T03:15:48.646863+0000","last_became_active":"2024-09-17T03:15:48.638188+0000","last_became_peered":"2024-09-17T03:15:48.638188+0000","last_unstale":"2024-09-17T03:15:48.646863+0000","last_undegraded":"2024-09-17T03:15:48.646863+0000","last_fullsized":"2024-09-17T03:15:48.646863+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.020557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120099+0000","last_change":"2024-09-17T03:15:47.625570+0000","last_active":"2024-09-17T03:15:50.120099+0000","last_peered":"2024-09-17T03:15:50.120099+0000","last_clean":"2024-09-17T03:15:50.120099+0000","last_became_active":"2024-09-17T03:15:47.625183+0000","last_became_peered":"2024-09-17T03:15:47.625183+0000","last_unstale":"2024-09-17T03:15:50.120099+0000","last_undegraded":"2024-09-17T03:15:50.120099+0000","last_fullsized":"2024-09-17T03:15:50.120099+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:42.594521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702347+0000","last_change":"2024-09-17T03:15:48.647526+0000","last_active":"2024-09-17T03:15:49.702347+0000","last_peered":"2024-09-17T03:15:49.702347+0000","last_clean":"2024-09-17T03:15:49.702347+0000","last_became_active":"2024-09-17T03:15:48.645428+0000","last_became_peered":"2024-09-17T03:15:48.645428+0000","last_unstale":"2024-09-17T03:15:49.702347+0000","last_undegraded":"2024-09-17T03:15:49.702347+0000","last_fullsized":"2024-09-17T03:15:49.702347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:56.293101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120174+0000","last_change":"2024-09-17T03:15:47.627338+0000","last_active":"2024-09-17T03:15:50.120174+0000","last_peered":"2024-09-17T03:15:50.120174+0000","last_clean":"2024-09-17T03:15:50.120174+0000","last_became_active":"2024-09-17T03:15:47.626848+0000","last_became_peered":"2024-09-17T03:15:47.626848+0000","last_unstale":"2024-09-17T03:15:50.120174+0000","last_undegraded":"2024-09-17T03:15:50.120174+0000","last_fullsized":"2024-09-17T03:15:50.120174+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:33.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760179+0000","last_change":"2024-09-17T03:15:48.623671+0000","last_active":"2024-09-17T03:15:49.760179+0000","last_peered":"2024-09-17T03:15:49.760179+0000","last_clean":"2024-09-17T03:15:49.760179+0000","last_became_active":"2024-09-17T03:15:48.623378+0000","last_became_peered":"2024-09-17T03:15:48.623378+0000","last_unstale":"2024-09-17T03:15:49.760179+0000","last_undegraded":"2024-09-17T03:15:49.760179+0000","last_fullsized":"2024-09-17T03:15:49.760179+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:22.919426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120109+0000","last_change":"2024-09-17T03:15:47.630012+0000","last_active":"2024-09-17T03:15:50.120109+0000","last_peered":"2024-09-17T03:15:50.120109+0000","last_clean":"2024-09-17T03:15:50.120109+0000","last_became_active":"2024-09-17T03:15:47.629613+0000","last_became_peered":"2024-09-17T03:15:47.629613+0000","last_unstale":"2024-09-17T03:15:50.120109+0000","last_undegraded":"2024-09-17T03:15:50.120109+0000","last_fullsized":"2024-09-17T03:15:50.120109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:19.097209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120267+0000","last_change":"2024-09-17T03:15:48.641981+0000","last_active":"2024-09-17T03:15:50.120267+0000","last_peered":"2024-09-17T03:15:50.120267+0000","last_clean":"2024-09-17T03:15:50.120267+0000","last_became_active":"2024-09-17T03:15:48.639767+0000","last_became_peered":"2024-09-17T03:15:48.639767+0000","last_unstale":"2024-09-17T03:15:50.120267+0000","last_undegraded":"2024-09-17T03:15:50.120267+0000","last_fullsized":"2024-09-17T03:15:50.120267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120172+0000","last_change":"2024-09-17T03:15:47.625406+0000","last_active":"2024-09-17T03:15:50.120172+0000","last_peered":"2024-09-17T03:15:50.120172+0000","last_clean":"2024-09-17T03:15:50.120172+0000","last_became_active":"2024-09-17T03:15:47.625121+0000","last_became_peered":"2024-09-17T03:15:47.625121+0000","last_unstale":"2024-09-17T03:15:50.120172+0000","last_undegraded":"2024-09-17T03:15:50.120172+0000","last_fullsized":"2024-09-17T03:15:50.120172+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:59.292954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630313+0000","last_change":"2024-09-17T03:15:48.636291+0000","last_active":"2024-09-17T03:15:49.630313+0000","last_peered":"2024-09-17T03:15:49.630313+0000","last_clean":"2024-09-17T03:15:49.630313+0000","last_became_active":"2024-09-17T03:15:48.635108+0000","last_became_peered":"2024-09-17T03:15:48.635108+0000","last_unstale":"2024-09-17T03:15:49.630313+0000","last_undegraded":"2024-09-17T03:15:49.630313+0000","last_fullsized":"2024-09-17T03:15:49.630313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:07.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629447+0000","last_change":"2024-09-17T03:15:47.624562+0000","last_active":"2024-09-17T03:15:49.629447+0000","last_peered":"2024-09-17T03:15:49.629447+0000","last_clean":"2024-09-17T03:15:49.629447+0000","last_became_active":"2024-09-17T03:15:47.624023+0000","last_became_peered":"2024-09-17T03:15:47.624023+0000","last_unstale":"2024-09-17T03:15:49.629447+0000","last_undegraded":"2024-09-17T03:15:49.629447+0000","last_fullsized":"2024-09-17T03:15:49.629447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:58.643244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120623+0000","last_change":"2024-09-17T03:15:48.644328+0000","last_active":"2024-09-17T03:15:50.120623+0000","last_peered":"2024-09-17T03:15:50.120623+0000","last_clean":"2024-09-17T03:15:50.120623+0000","last_became_active":"2024-09-17T03:15:48.642543+0000","last_became_peered":"2024-09-17T03:15:48.642543+0000","last_unstale":"2024-09-17T03:15:50.120623+0000","last_undegraded":"2024-09-17T03:15:50.120623+0000","last_fullsized":"2024-09-17T03:15:50.120623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:52.338692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120435+0000","last_change":"2024-09-17T03:15:47.629462+0000","last_active":"2024-09-17T03:15:50.120435+0000","last_peered":"2024-09-17T03:15:50.120435+0000","last_clean":"2024-09-17T03:15:50.120435+0000","last_became_active":"2024-09-17T03:15:47.629016+0000","last_became_peered":"2024-09-17T03:15:47.629016+0000","last_unstale":"2024-09-17T03:15:50.120435+0000","last_undegraded":"2024-09-17T03:15:50.120435+0000","last_fullsized":"2024-09-17T03:15:50.120435+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.698885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631430+0000","last_change":"2024-09-17T03:15:48.644919+0000","last_active":"2024-09-17T03:15:49.631430+0000","last_peered":"2024-09-17T03:15:49.631430+0000","last_clean":"2024-09-17T03:15:49.631430+0000","last_became_active":"2024-09-17T03:15:48.644648+0000","last_became_peered":"2024-09-17T03:15:48.644648+0000","last_unstale":"2024-09-17T03:15:49.631430+0000","last_undegraded":"2024-09-17T03:15:49.631430+0000","last_fullsized":"2024-09-17T03:15:49.631430+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:56.293101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629678+0000","last_change":"2024-09-17T03:15:47.626840+0000","last_active":"2024-09-17T03:15:49.629678+0000","last_peered":"2024-09-17T03:15:49.629678+0000","last_clean":"2024-09-17T03:15:49.629678+0000","last_became_active":"2024-09-17T03:15:47.626525+0000","last_became_peered":"2024-09-17T03:15:47.626525+0000","last_unstale":"2024-09-17T03:15:49.629678+0000","last_undegraded":"2024-09-17T03:15:49.629678+0000","last_fullsized":"2024-09-17T03:15:49.629678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:04.579860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120852+0000","last_change":"2024-09-17T03:15:48.644492+0000","last_active":"2024-09-17T03:15:50.120852+0000","last_peered":"2024-09-17T03:15:50.120852+0000","last_clean":"2024-09-17T03:15:50.120852+0000","last_became_active":"2024-09-17T03:15:48.640615+0000","last_became_peered":"2024-09-17T03:15:48.640615+0000","last_unstale":"2024-09-17T03:15:50.120852+0000","last_undegraded":"2024-09-17T03:15:50.120852+0000","last_fullsized":"2024-09-17T03:15:50.120852+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:20.377681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630712+0000","last_change":"2024-09-17T03:15:47.619649+0000","last_active":"2024-09-17T03:15:49.630712+0000","last_peered":"2024-09-17T03:15:49.630712+0000","last_clean":"2024-09-17T03:15:49.630712+0000","last_became_active":"2024-09-17T03:15:47.619327+0000","last_became_peered":"2024-09-17T03:15:47.619327+0000","last_unstale":"2024-09-17T03:15:49.630712+0000","last_undegraded":"2024-09-17T03:15:49.630712+0000","last_fullsized":"2024-09-17T03:15:49.630712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:22.026498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702129+0000","last_change":"2024-09-17T03:15:48.647585+0000","last_active":"2024-09-17T03:15:49.702129+0000","last_peered":"2024-09-17T03:15:49.702129+0000","last_clean":"2024-09-17T03:15:49.702129+0000","last_became_active":"2024-09-17T03:15:48.647202+0000","last_became_peered":"2024-09-17T03:15:48.647202+0000","last_unstale":"2024-09-17T03:15:49.702129+0000","last_undegraded":"2024-09-17T03:15:49.702129+0000","last_fullsized":"2024-09-17T03:15:49.702129+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.968414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.759977+0000","last_change":"2024-09-17T03:15:47.628535+0000","last_active":"2024-09-17T03:15:49.759977+0000","last_peered":"2024-09-17T03:15:49.759977+0000","last_clean":"2024-09-17T03:15:49.759977+0000","last_became_active":"2024-09-17T03:15:47.628167+0000","last_became_peered":"2024-09-17T03:15:47.628167+0000","last_unstale":"2024-09-17T03:15:49.759977+0000","last_undegraded":"2024-09-17T03:15:49.759977+0000","last_fullsized":"2024-09-17T03:15:49.759977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:58.104495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777030+0000","last_change":"2024-09-17T03:15:48.626698+0000","last_active":"2024-09-17T03:15:49.777030+0000","last_peered":"2024-09-17T03:15:49.777030+0000","last_clean":"2024-09-17T03:15:49.777030+0000","last_became_active":"2024-09-17T03:15:48.626410+0000","last_became_peered":"2024-09-17T03:15:48.626410+0000","last_unstale":"2024-09-17T03:15:49.777030+0000","last_undegraded":"2024-09-17T03:15:49.777030+0000","last_fullsized":"2024-09-17T03:15:49.777030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:17.555955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"58'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.613372+0000","last_change":"2024-09-17T03:15:47.625794+0000","last_active":"2024-09-17T03:15:50.613372+0000","last_peered":"2024-09-17T03:15:50.613372+0000","last_clean":"2024-09-17T03:15:50.613372+0000","last_became_active":"2024-09-17T03:15:47.625428+0000","last_became_peered":"2024-09-17T03:15:47.625428+0000","last_unstale":"2024-09-17T03:15:50.613372+0000","last_undegraded":"2024-09-17T03:15:50.613372+0000","last_fullsized":"2024-09-17T03:15:50.613372+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:51.218844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760124+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:15:49.760124+0000","last_peered":"2024-09-17T03:15:49.760124+0000","last_clean":"2024-09-17T03:15:49.760124+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:15:49.760124+0000","last_undegraded":"2024-09-17T03:15:49.760124+0000","last_fullsized":"2024-09-17T03:15:49.760124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":692224,"data_stored":307767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1294336,"data_stored":899781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":704512,"data_stored":309415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":307801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":307745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":898149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":308293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":301601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:53.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 -- 172.21.15.153:0/3426235355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d48070b20 msgr2=0x7f7d4815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/3426235355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d48070b20 0x7f7d4815f000 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7d48072850 tx=0x7f7d3402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 -- 172.21.15.153:0/3426235355 shutdown_connections 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/3426235355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d48070b20 0x7f7d4815f000 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/3426235355 >> v2:172.21.15.164:3300/0 conn(0x7f7d480cbf40 0x7f7d480705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 -- 172.21.15.153:0/3426235355 >> 172.21.15.153:0/3426235355 conn(0x7f7d480d0070 msgr2=0x7f7d480d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:53.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 -- 172.21.15.153:0/3426235355 shutdown_connections 2024-09-17T03:15:53.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.315+0000 7f7d4cc00640 1 -- 172.21.15.153:0/3426235355 wait complete. 2024-09-17T03:15:53.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.317+0000 7f7d4cc00640 1 Processor -- start 2024-09-17T03:15:53.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.317+0000 7f7d4cc00640 1 -- start start 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.318+0000 7f7d4cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d48070b20 0x7f7d480c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.318+0000 7f7d4cc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d480cbf40 0x7f7d481f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.318+0000 7f7d4cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d4cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481524d0 con 0x7f7d4815f540 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d4cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48152350 con 0x7f7d48070b20 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d4cc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7d48152650 con 0x7f7d480cbf40 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55754/0 (socket says 172.21.15.153:55754) 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 -- 172.21.15.153:0/167250819 learned_addr learned my addr 172.21.15.153:0/167250819 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:53.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d45e00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d48070b20 0x7f7d480c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d45400640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d480cbf40 0x7f7d481f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 -- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d480cbf40 msgr2=0x7f7d481f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d480cbf40 0x7f7d481f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 -- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d48070b20 msgr2=0x7f7d480c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d48070b20 0x7f7d480c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.319+0000 7f7d46800640 1 -- 172.21.15.153:0/167250819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d481fa360 con 0x7f7d4815f540 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d46800640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c760 tx=0x7f7d4000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40016020 con 0x7f7d4815f540 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d40003990 con 0x7f7d4815f540 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40006e60 con 0x7f7d4815f540 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d481f9ac0 con 0x7f7d4815f540 2024-09-17T03:15:53.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.320+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481fa080 con 0x7f7d4815f540 2024-09-17T03:15:53.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.321+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d481f9830 con 0x7f7d4815f540 2024-09-17T03:15:53.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.322+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d400050d0 con 0x7f7d4815f540 2024-09-17T03:15:53.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.323+0000 7f7d3e000640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 0x7f7d2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.323+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f7d4009aab0 con 0x7f7d4815f540 2024-09-17T03:15:53.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.324+0000 7f7d45e00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 0x7f7d2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.324+0000 7f7d45e00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 0x7f7d2807b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d38005fd0 tx=0x7f7d38005850 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:53.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.328+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d40020020 con 0x7f7d4815f540 2024-09-17T03:15:53.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.508+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d4815f000 con 0x7f7d28078bc0 2024-09-17T03:15:53.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.513+0000 7f7d3e000640 1 -- 172.21.15.153:0/167250819 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f7d4815f000 con 0x7f7d28078bc0 2024-09-17T03:15:53.515 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:53.517 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 msgr2=0x7f7d2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 0x7f7d2807b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d38005fd0 tx=0x7f7d38005850 comp rx=0 tx=0).stop 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 msgr2=0x7f7d481f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c760 tx=0x7f7d4000cb60 comp rx=0 tx=0).stop 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 shutdown_connections 2024-09-17T03:15:53.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f7d28078bc0 0x7f7d2807b0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d4815f540 0x7f7d481f6a60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7d480cbf40 0x7f7d481f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 --2- 172.21.15.153:0/167250819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d48070b20 0x7f7d480c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 >> 172.21.15.153:0/167250819 conn(0x7f7d480d0070 msgr2=0x7f7d480cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 shutdown_connections 2024-09-17T03:15:53.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.517+0000 7f7d4cc00640 1 -- 172.21.15.153:0/167250819 wait complete. 2024-09-17T03:15:53.537 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-17T03:15:52.854522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226980,"kb_used_data":6556,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747740,"statfs":{"total":773094113280,"available":772861685760,"internally_reserved":0,"allocated":6713344,"data_stored":3640552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001593"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640132+0000","last_change":"2024-09-17T03:15:48.626565+0000","last_active":"2024-09-17T03:15:48.640132+0000","last_peered":"2024-09-17T03:15:48.640132+0000","last_clean":"2024-09-17T03:15:48.640132+0000","last_became_active":"2024-09-17T03:15:48.626198+0000","last_became_peered":"2024-09-17T03:15:48.626198+0000","last_unstale":"2024-09-17T03:15:48.640132+0000","last_undegraded":"2024-09-17T03:15:48.640132+0000","last_fullsized":"2024-09-17T03:15:48.640132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:01.791030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631615+0000","last_change":"2024-09-17T03:15:48.638730+0000","last_active":"2024-09-17T03:15:49.631615+0000","last_peered":"2024-09-17T03:15:49.631615+0000","last_clean":"2024-09-17T03:15:49.631615+0000","last_became_active":"2024-09-17T03:15:48.638410+0000","last_became_peered":"2024-09-17T03:15:48.638410+0000","last_unstale":"2024-09-17T03:15:49.631615+0000","last_undegraded":"2024-09-17T03:15:49.631615+0000","last_fullsized":"2024-09-17T03:15:49.631615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:40.677347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629752+0000","last_change":"2024-09-17T03:15:48.623546+0000","last_active":"2024-09-17T03:15:49.629752+0000","last_peered":"2024-09-17T03:15:49.629752+0000","last_clean":"2024-09-17T03:15:49.629752+0000","last_became_active":"2024-09-17T03:15:48.623250+0000","last_became_peered":"2024-09-17T03:15:48.623250+0000","last_unstale":"2024-09-17T03:15:49.629752+0000","last_undegraded":"2024-09-17T03:15:49.629752+0000","last_fullsized":"2024-09-17T03:15:49.629752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:13.086151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760410+0000","last_change":"2024-09-17T03:15:48.636711+0000","last_active":"2024-09-17T03:15:49.760410+0000","last_peered":"2024-09-17T03:15:49.760410+0000","last_clean":"2024-09-17T03:15:49.760410+0000","last_became_active":"2024-09-17T03:15:48.635391+0000","last_became_peered":"2024-09-17T03:15:48.635391+0000","last_unstale":"2024-09-17T03:15:49.760410+0000","last_undegraded":"2024-09-17T03:15:49.760410+0000","last_fullsized":"2024-09-17T03:15:49.760410+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:53.037491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630981+0000","last_change":"2024-09-17T03:15:48.646594+0000","last_active":"2024-09-17T03:15:49.630981+0000","last_peered":"2024-09-17T03:15:49.630981+0000","last_clean":"2024-09-17T03:15:49.630981+0000","last_became_active":"2024-09-17T03:15:48.646047+0000","last_became_peered":"2024-09-17T03:15:48.646047+0000","last_unstale":"2024-09-17T03:15:49.630981+0000","last_undegraded":"2024-09-17T03:15:49.630981+0000","last_fullsized":"2024-09-17T03:15:49.630981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:47.885285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701856+0000","last_change":"2024-09-17T03:15:48.638342+0000","last_active":"2024-09-17T03:15:49.701856+0000","last_peered":"2024-09-17T03:15:49.701856+0000","last_clean":"2024-09-17T03:15:49.701856+0000","last_became_active":"2024-09-17T03:15:48.637004+0000","last_became_peered":"2024-09-17T03:15:48.637004+0000","last_unstale":"2024-09-17T03:15:49.701856+0000","last_undegraded":"2024-09-17T03:15:49.701856+0000","last_fullsized":"2024-09-17T03:15:49.701856+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:26.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120219+0000","last_change":"2024-09-17T03:15:48.632240+0000","last_active":"2024-09-17T03:15:50.120219+0000","last_peered":"2024-09-17T03:15:50.120219+0000","last_clean":"2024-09-17T03:15:50.120219+0000","last_became_active":"2024-09-17T03:15:48.631898+0000","last_became_peered":"2024-09-17T03:15:48.631898+0000","last_unstale":"2024-09-17T03:15:50.120219+0000","last_undegraded":"2024-09-17T03:15:50.120219+0000","last_fullsized":"2024-09-17T03:15:50.120219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:45.843144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701734+0000","last_change":"2024-09-17T03:15:48.633015+0000","last_active":"2024-09-17T03:15:49.701734+0000","last_peered":"2024-09-17T03:15:49.701734+0000","last_clean":"2024-09-17T03:15:49.701734+0000","last_became_active":"2024-09-17T03:15:48.632719+0000","last_became_peered":"2024-09-17T03:15:48.632719+0000","last_unstale":"2024-09-17T03:15:49.701734+0000","last_undegraded":"2024-09-17T03:15:49.701734+0000","last_fullsized":"2024-09-17T03:15:49.701734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:39.909544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630449+0000","last_change":"2024-09-17T03:15:48.621423+0000","last_active":"2024-09-17T03:15:49.630449+0000","last_peered":"2024-09-17T03:15:49.630449+0000","last_clean":"2024-09-17T03:15:49.630449+0000","last_became_active":"2024-09-17T03:15:48.621103+0000","last_became_peered":"2024-09-17T03:15:48.621103+0000","last_unstale":"2024-09-17T03:15:49.630449+0000","last_undegraded":"2024-09-17T03:15:49.630449+0000","last_fullsized":"2024-09-17T03:15:49.630449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.163544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120695+0000","last_change":"2024-09-17T03:15:48.646614+0000","last_active":"2024-09-17T03:15:50.120695+0000","last_peered":"2024-09-17T03:15:50.120695+0000","last_clean":"2024-09-17T03:15:50.120695+0000","last_became_active":"2024-09-17T03:15:48.646259+0000","last_became_peered":"2024-09-17T03:15:48.646259+0000","last_unstale":"2024-09-17T03:15:50.120695+0000","last_undegraded":"2024-09-17T03:15:50.120695+0000","last_fullsized":"2024-09-17T03:15:50.120695+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:26.740309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.633177+0000","last_change":"2024-09-17T03:15:48.624193+0000","last_active":"2024-09-17T03:15:48.633177+0000","last_peered":"2024-09-17T03:15:48.633177+0000","last_clean":"2024-09-17T03:15:48.633177+0000","last_became_active":"2024-09-17T03:15:48.623874+0000","last_became_peered":"2024-09-17T03:15:48.623874+0000","last_unstale":"2024-09-17T03:15:48.633177+0000","last_undegraded":"2024-09-17T03:15:48.633177+0000","last_fullsized":"2024-09-17T03:15:48.633177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:04.756500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701807+0000","last_change":"2024-09-17T03:15:48.642544+0000","last_active":"2024-09-17T03:15:49.701807+0000","last_peered":"2024-09-17T03:15:49.701807+0000","last_clean":"2024-09-17T03:15:49.701807+0000","last_became_active":"2024-09-17T03:15:48.642205+0000","last_became_peered":"2024-09-17T03:15:48.642205+0000","last_unstale":"2024-09-17T03:15:49.701807+0000","last_undegraded":"2024-09-17T03:15:49.701807+0000","last_fullsized":"2024-09-17T03:15:49.701807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:10.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702156+0000","last_change":"2024-09-17T03:15:48.644018+0000","last_active":"2024-09-17T03:15:49.702156+0000","last_peered":"2024-09-17T03:15:49.702156+0000","last_clean":"2024-09-17T03:15:49.702156+0000","last_became_active":"2024-09-17T03:15:48.640950+0000","last_became_peered":"2024-09-17T03:15:48.640950+0000","last_unstale":"2024-09-17T03:15:49.702156+0000","last_undegraded":"2024-09-17T03:15:49.702156+0000","last_fullsized":"2024-09-17T03:15:49.702156+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:23.322949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646740+0000","last_change":"2024-09-17T03:15:48.632849+0000","last_active":"2024-09-17T03:15:48.646740+0000","last_peered":"2024-09-17T03:15:48.646740+0000","last_clean":"2024-09-17T03:15:48.646740+0000","last_became_active":"2024-09-17T03:15:48.632526+0000","last_became_peered":"2024-09-17T03:15:48.632526+0000","last_unstale":"2024-09-17T03:15:48.646740+0000","last_undegraded":"2024-09-17T03:15:48.646740+0000","last_fullsized":"2024-09-17T03:15:48.646740+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:23.201935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760185+0000","last_change":"2024-09-17T03:15:48.625846+0000","last_active":"2024-09-17T03:15:49.760185+0000","last_peered":"2024-09-17T03:15:49.760185+0000","last_clean":"2024-09-17T03:15:49.760185+0000","last_became_active":"2024-09-17T03:15:48.625475+0000","last_became_peered":"2024-09-17T03:15:48.625475+0000","last_unstale":"2024-09-17T03:15:49.760185+0000","last_undegraded":"2024-09-17T03:15:49.760185+0000","last_fullsized":"2024-09-17T03:15:49.760185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:13.465251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701789+0000","last_change":"2024-09-17T03:15:48.623026+0000","last_active":"2024-09-17T03:15:49.701789+0000","last_peered":"2024-09-17T03:15:49.701789+0000","last_clean":"2024-09-17T03:15:49.701789+0000","last_became_active":"2024-09-17T03:15:48.622654+0000","last_became_peered":"2024-09-17T03:15:48.622654+0000","last_unstale":"2024-09-17T03:15:49.701789+0000","last_undegraded":"2024-09-17T03:15:49.701789+0000","last_fullsized":"2024-09-17T03:15:49.701789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:01.612794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640161+0000","last_change":"2024-09-17T03:15:48.626656+0000","last_active":"2024-09-17T03:15:48.640161+0000","last_peered":"2024-09-17T03:15:48.640161+0000","last_clean":"2024-09-17T03:15:48.640161+0000","last_became_active":"2024-09-17T03:15:48.625464+0000","last_became_peered":"2024-09-17T03:15:48.625464+0000","last_unstale":"2024-09-17T03:15:48.640161+0000","last_undegraded":"2024-09-17T03:15:48.640161+0000","last_fullsized":"2024-09-17T03:15:48.640161+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:34.179629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760563+0000","last_change":"2024-09-17T03:15:48.634840+0000","last_active":"2024-09-17T03:15:49.760563+0000","last_peered":"2024-09-17T03:15:49.760563+0000","last_clean":"2024-09-17T03:15:49.760563+0000","last_became_active":"2024-09-17T03:15:48.634561+0000","last_became_peered":"2024-09-17T03:15:48.634561+0000","last_unstale":"2024-09-17T03:15:49.760563+0000","last_undegraded":"2024-09-17T03:15:49.760563+0000","last_fullsized":"2024-09-17T03:15:49.760563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:02.971081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629995+0000","last_change":"2024-09-17T03:15:48.639087+0000","last_active":"2024-09-17T03:15:49.629995+0000","last_peered":"2024-09-17T03:15:49.629995+0000","last_clean":"2024-09-17T03:15:49.629995+0000","last_became_active":"2024-09-17T03:15:48.637509+0000","last_became_peered":"2024-09-17T03:15:48.637509+0000","last_unstale":"2024-09-17T03:15:49.629995+0000","last_undegraded":"2024-09-17T03:15:49.629995+0000","last_fullsized":"2024-09-17T03:15:49.629995+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:21.103079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631255+0000","last_change":"2024-09-17T03:15:48.641863+0000","last_active":"2024-09-17T03:15:49.631255+0000","last_peered":"2024-09-17T03:15:49.631255+0000","last_clean":"2024-09-17T03:15:49.631255+0000","last_became_active":"2024-09-17T03:15:48.638778+0000","last_became_peered":"2024-09-17T03:15:48.638778+0000","last_unstale":"2024-09-17T03:15:49.631255+0000","last_undegraded":"2024-09-17T03:15:49.631255+0000","last_fullsized":"2024-09-17T03:15:49.631255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:23.322949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760220+0000","last_change":"2024-09-17T03:15:48.628962+0000","last_active":"2024-09-17T03:15:49.760220+0000","last_peered":"2024-09-17T03:15:49.760220+0000","last_clean":"2024-09-17T03:15:49.760220+0000","last_became_active":"2024-09-17T03:15:48.628675+0000","last_became_peered":"2024-09-17T03:15:48.628675+0000","last_unstale":"2024-09-17T03:15:49.760220+0000","last_undegraded":"2024-09-17T03:15:49.760220+0000","last_fullsized":"2024-09-17T03:15:49.760220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:45.357011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629086+0000","last_change":"2024-09-17T03:15:48.631924+0000","last_active":"2024-09-17T03:15:49.629086+0000","last_peered":"2024-09-17T03:15:49.629086+0000","last_clean":"2024-09-17T03:15:49.629086+0000","last_became_active":"2024-09-17T03:15:48.628269+0000","last_became_peered":"2024-09-17T03:15:48.628269+0000","last_unstale":"2024-09-17T03:15:49.629086+0000","last_undegraded":"2024-09-17T03:15:49.629086+0000","last_fullsized":"2024-09-17T03:15:49.629086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:20.099988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628696+0000","last_change":"2024-09-17T03:15:48.631326+0000","last_active":"2024-09-17T03:15:49.628696+0000","last_peered":"2024-09-17T03:15:49.628696+0000","last_clean":"2024-09-17T03:15:49.628696+0000","last_became_active":"2024-09-17T03:15:48.626998+0000","last_became_peered":"2024-09-17T03:15:48.626998+0000","last_unstale":"2024-09-17T03:15:49.628696+0000","last_undegraded":"2024-09-17T03:15:49.628696+0000","last_fullsized":"2024-09-17T03:15:49.628696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:12.079223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628745+0000","last_change":"2024-09-17T03:15:48.632275+0000","last_active":"2024-09-17T03:15:49.628745+0000","last_peered":"2024-09-17T03:15:49.628745+0000","last_clean":"2024-09-17T03:15:49.628745+0000","last_became_active":"2024-09-17T03:15:48.631991+0000","last_became_peered":"2024-09-17T03:15:48.631991+0000","last_unstale":"2024-09-17T03:15:49.628745+0000","last_undegraded":"2024-09-17T03:15:49.628745+0000","last_fullsized":"2024-09-17T03:15:49.628745+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:16.285113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.640517+0000","last_change":"2024-09-17T03:15:48.630609+0000","last_active":"2024-09-17T03:15:48.640517+0000","last_peered":"2024-09-17T03:15:48.640517+0000","last_clean":"2024-09-17T03:15:48.640517+0000","last_became_active":"2024-09-17T03:15:48.630237+0000","last_became_peered":"2024-09-17T03:15:48.630237+0000","last_unstale":"2024-09-17T03:15:48.640517+0000","last_undegraded":"2024-09-17T03:15:48.640517+0000","last_fullsized":"2024-09-17T03:15:48.640517+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:08.738098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630020+0000","last_change":"2024-09-17T03:15:48.620122+0000","last_active":"2024-09-17T03:15:49.630020+0000","last_peered":"2024-09-17T03:15:49.630020+0000","last_clean":"2024-09-17T03:15:49.630020+0000","last_became_active":"2024-09-17T03:15:48.619712+0000","last_became_peered":"2024-09-17T03:15:48.619712+0000","last_unstale":"2024-09-17T03:15:49.630020+0000","last_undegraded":"2024-09-17T03:15:49.630020+0000","last_fullsized":"2024-09-17T03:15:49.630020+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:55.359196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702010+0000","last_change":"2024-09-17T03:15:48.643453+0000","last_active":"2024-09-17T03:15:49.702010+0000","last_peered":"2024-09-17T03:15:49.702010+0000","last_clean":"2024-09-17T03:15:49.702010+0000","last_became_active":"2024-09-17T03:15:48.643154+0000","last_became_peered":"2024-09-17T03:15:48.643154+0000","last_unstale":"2024-09-17T03:15:49.702010+0000","last_undegraded":"2024-09-17T03:15:49.702010+0000","last_fullsized":"2024-09-17T03:15:49.702010+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:47.885285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631284+0000","last_change":"2024-09-17T03:15:48.646408+0000","last_active":"2024-09-17T03:15:49.631284+0000","last_peered":"2024-09-17T03:15:49.631284+0000","last_clean":"2024-09-17T03:15:49.631284+0000","last_became_active":"2024-09-17T03:15:48.646074+0000","last_became_peered":"2024-09-17T03:15:48.646074+0000","last_unstale":"2024-09-17T03:15:49.631284+0000","last_undegraded":"2024-09-17T03:15:49.631284+0000","last_fullsized":"2024-09-17T03:15:49.631284+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.813853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646684+0000","last_change":"2024-09-17T03:15:48.637323+0000","last_active":"2024-09-17T03:15:48.646684+0000","last_peered":"2024-09-17T03:15:48.646684+0000","last_clean":"2024-09-17T03:15:48.646684+0000","last_became_active":"2024-09-17T03:15:48.636145+0000","last_became_peered":"2024-09-17T03:15:48.636145+0000","last_unstale":"2024-09-17T03:15:48.646684+0000","last_undegraded":"2024-09-17T03:15:48.646684+0000","last_fullsized":"2024-09-17T03:15:48.646684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:03.409428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120082+0000","last_change":"2024-09-17T03:15:48.640751+0000","last_active":"2024-09-17T03:15:50.120082+0000","last_peered":"2024-09-17T03:15:50.120082+0000","last_clean":"2024-09-17T03:15:50.120082+0000","last_became_active":"2024-09-17T03:15:48.640416+0000","last_became_peered":"2024-09-17T03:15:48.640416+0000","last_unstale":"2024-09-17T03:15:50.120082+0000","last_undegraded":"2024-09-17T03:15:50.120082+0000","last_fullsized":"2024-09-17T03:15:50.120082+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:50.068343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.628955+0000","last_change":"2024-09-17T03:15:48.631624+0000","last_active":"2024-09-17T03:15:49.628955+0000","last_peered":"2024-09-17T03:15:49.628955+0000","last_clean":"2024-09-17T03:15:49.628955+0000","last_became_active":"2024-09-17T03:15:48.627380+0000","last_became_peered":"2024-09-17T03:15:48.627380+0000","last_unstale":"2024-09-17T03:15:49.628955+0000","last_undegraded":"2024-09-17T03:15:49.628955+0000","last_fullsized":"2024-09-17T03:15:49.628955+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:00.295733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630602+0000","last_change":"2024-09-17T03:15:48.621553+0000","last_active":"2024-09-17T03:15:49.630602+0000","last_peered":"2024-09-17T03:15:49.630602+0000","last_clean":"2024-09-17T03:15:49.630602+0000","last_became_active":"2024-09-17T03:15:48.621232+0000","last_became_peered":"2024-09-17T03:15:48.621232+0000","last_unstale":"2024-09-17T03:15:49.630602+0000","last_undegraded":"2024-09-17T03:15:49.630602+0000","last_fullsized":"2024-09-17T03:15:49.630602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:44.384503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120160+0000","last_change":"2024-09-17T03:15:48.641997+0000","last_active":"2024-09-17T03:15:50.120160+0000","last_peered":"2024-09-17T03:15:50.120160+0000","last_clean":"2024-09-17T03:15:50.120160+0000","last_became_active":"2024-09-17T03:15:48.641607+0000","last_became_peered":"2024-09-17T03:15:48.641607+0000","last_unstale":"2024-09-17T03:15:50.120160+0000","last_undegraded":"2024-09-17T03:15:50.120160+0000","last_fullsized":"2024-09-17T03:15:50.120160+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:54.682775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777313+0000","last_change":"2024-09-17T03:15:47.626799+0000","last_active":"2024-09-17T03:15:49.777313+0000","last_peered":"2024-09-17T03:15:49.777313+0000","last_clean":"2024-09-17T03:15:49.777313+0000","last_became_active":"2024-09-17T03:15:47.626492+0000","last_became_peered":"2024-09-17T03:15:47.626492+0000","last_unstale":"2024-09-17T03:15:49.777313+0000","last_undegraded":"2024-09-17T03:15:49.777313+0000","last_fullsized":"2024-09-17T03:15:49.777313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:08.754255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.119944+0000","last_change":"2024-09-17T03:15:48.638690+0000","last_active":"2024-09-17T03:15:50.119944+0000","last_peered":"2024-09-17T03:15:50.119944+0000","last_clean":"2024-09-17T03:15:50.119944+0000","last_became_active":"2024-09-17T03:15:48.638355+0000","last_became_peered":"2024-09-17T03:15:48.638355+0000","last_unstale":"2024-09-17T03:15:50.119944+0000","last_undegraded":"2024-09-17T03:15:50.119944+0000","last_fullsized":"2024-09-17T03:15:50.119944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:31.132948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702110+0000","last_change":"2024-09-17T03:15:47.632513+0000","last_active":"2024-09-17T03:15:49.702110+0000","last_peered":"2024-09-17T03:15:49.702110+0000","last_clean":"2024-09-17T03:15:49.702110+0000","last_became_active":"2024-09-17T03:15:47.631966+0000","last_became_peered":"2024-09-17T03:15:47.631966+0000","last_unstale":"2024-09-17T03:15:49.702110+0000","last_undegraded":"2024-09-17T03:15:49.702110+0000","last_fullsized":"2024-09-17T03:15:49.702110+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:13.293469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120087+0000","last_change":"2024-09-17T03:15:48.643546+0000","last_active":"2024-09-17T03:15:50.120087+0000","last_peered":"2024-09-17T03:15:50.120087+0000","last_clean":"2024-09-17T03:15:50.120087+0000","last_became_active":"2024-09-17T03:15:48.642921+0000","last_became_peered":"2024-09-17T03:15:48.642921+0000","last_unstale":"2024-09-17T03:15:50.120087+0000","last_undegraded":"2024-09-17T03:15:50.120087+0000","last_fullsized":"2024-09-17T03:15:50.120087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:33.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120592+0000","last_change":"2024-09-17T03:15:47.627161+0000","last_active":"2024-09-17T03:15:50.120592+0000","last_peered":"2024-09-17T03:15:50.120592+0000","last_clean":"2024-09-17T03:15:50.120592+0000","last_became_active":"2024-09-17T03:15:47.625250+0000","last_became_peered":"2024-09-17T03:15:47.625250+0000","last_unstale":"2024-09-17T03:15:50.120592+0000","last_undegraded":"2024-09-17T03:15:50.120592+0000","last_fullsized":"2024-09-17T03:15:50.120592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:03.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120308+0000","last_change":"2024-09-17T03:15:48.641354+0000","last_active":"2024-09-17T03:15:50.120308+0000","last_peered":"2024-09-17T03:15:50.120308+0000","last_clean":"2024-09-17T03:15:50.120308+0000","last_became_active":"2024-09-17T03:15:48.641025+0000","last_became_peered":"2024-09-17T03:15:48.641025+0000","last_unstale":"2024-09-17T03:15:50.120308+0000","last_undegraded":"2024-09-17T03:15:50.120308+0000","last_fullsized":"2024-09-17T03:15:50.120308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:07.829496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631425+0000","last_change":"2024-09-17T03:15:47.621974+0000","last_active":"2024-09-17T03:15:49.631425+0000","last_peered":"2024-09-17T03:15:49.631425+0000","last_clean":"2024-09-17T03:15:49.631425+0000","last_became_active":"2024-09-17T03:15:47.621567+0000","last_became_peered":"2024-09-17T03:15:47.621567+0000","last_unstale":"2024-09-17T03:15:49.631425+0000","last_undegraded":"2024-09-17T03:15:49.631425+0000","last_fullsized":"2024-09-17T03:15:49.631425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:59.335584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777252+0000","last_change":"2024-09-17T03:15:48.639078+0000","last_active":"2024-09-17T03:15:49.777252+0000","last_peered":"2024-09-17T03:15:49.777252+0000","last_clean":"2024-09-17T03:15:49.777252+0000","last_became_active":"2024-09-17T03:15:48.638719+0000","last_became_peered":"2024-09-17T03:15:48.638719+0000","last_unstale":"2024-09-17T03:15:49.777252+0000","last_undegraded":"2024-09-17T03:15:49.777252+0000","last_fullsized":"2024-09-17T03:15:49.777252+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:54.621130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630607+0000","last_change":"2024-09-17T03:15:47.628446+0000","last_active":"2024-09-17T03:15:49.630607+0000","last_peered":"2024-09-17T03:15:49.630607+0000","last_clean":"2024-09-17T03:15:49.630607+0000","last_became_active":"2024-09-17T03:15:47.626028+0000","last_became_peered":"2024-09-17T03:15:47.626028+0000","last_unstale":"2024-09-17T03:15:49.630607+0000","last_undegraded":"2024-09-17T03:15:49.630607+0000","last_fullsized":"2024-09-17T03:15:49.630607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:19.374903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120106+0000","last_change":"2024-09-17T03:15:48.643456+0000","last_active":"2024-09-17T03:15:50.120106+0000","last_peered":"2024-09-17T03:15:50.120106+0000","last_clean":"2024-09-17T03:15:50.120106+0000","last_became_active":"2024-09-17T03:15:48.643184+0000","last_became_peered":"2024-09-17T03:15:48.643184+0000","last_unstale":"2024-09-17T03:15:50.120106+0000","last_undegraded":"2024-09-17T03:15:50.120106+0000","last_fullsized":"2024-09-17T03:15:50.120106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:21.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120222+0000","last_change":"2024-09-17T03:15:47.625119+0000","last_active":"2024-09-17T03:15:50.120222+0000","last_peered":"2024-09-17T03:15:50.120222+0000","last_clean":"2024-09-17T03:15:50.120222+0000","last_became_active":"2024-09-17T03:15:47.624727+0000","last_became_peered":"2024-09-17T03:15:47.624727+0000","last_unstale":"2024-09-17T03:15:50.120222+0000","last_undegraded":"2024-09-17T03:15:50.120222+0000","last_fullsized":"2024-09-17T03:15:50.120222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:11.076444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120645+0000","last_change":"2024-09-17T03:15:48.644886+0000","last_active":"2024-09-17T03:15:50.120645+0000","last_peered":"2024-09-17T03:15:50.120645+0000","last_clean":"2024-09-17T03:15:50.120645+0000","last_became_active":"2024-09-17T03:15:48.643453+0000","last_became_peered":"2024-09-17T03:15:48.643453+0000","last_unstale":"2024-09-17T03:15:50.120645+0000","last_undegraded":"2024-09-17T03:15:50.120645+0000","last_fullsized":"2024-09-17T03:15:50.120645+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:17.649319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.119880+0000","last_change":"2024-09-17T03:15:47.626469+0000","last_active":"2024-09-17T03:15:50.119880+0000","last_peered":"2024-09-17T03:15:50.119880+0000","last_clean":"2024-09-17T03:15:50.119880+0000","last_became_active":"2024-09-17T03:15:47.626128+0000","last_became_peered":"2024-09-17T03:15:47.626128+0000","last_unstale":"2024-09-17T03:15:50.119880+0000","last_undegraded":"2024-09-17T03:15:50.119880+0000","last_fullsized":"2024-09-17T03:15:50.119880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:36.897288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760629+0000","last_change":"2024-09-17T03:15:48.634089+0000","last_active":"2024-09-17T03:15:49.760629+0000","last_peered":"2024-09-17T03:15:49.760629+0000","last_clean":"2024-09-17T03:15:49.760629+0000","last_became_active":"2024-09-17T03:15:48.633770+0000","last_became_peered":"2024-09-17T03:15:48.633770+0000","last_unstale":"2024-09-17T03:15:49.760629+0000","last_undegraded":"2024-09-17T03:15:49.760629+0000","last_fullsized":"2024-09-17T03:15:49.760629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:47.819332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629528+0000","last_change":"2024-09-17T03:15:47.625533+0000","last_active":"2024-09-17T03:15:49.629528+0000","last_peered":"2024-09-17T03:15:49.629528+0000","last_clean":"2024-09-17T03:15:49.629528+0000","last_became_active":"2024-09-17T03:15:47.624712+0000","last_became_peered":"2024-09-17T03:15:47.624712+0000","last_unstale":"2024-09-17T03:15:49.629528+0000","last_undegraded":"2024-09-17T03:15:49.629528+0000","last_fullsized":"2024-09-17T03:15:49.629528+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.291174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.776968+0000","last_change":"2024-09-17T03:15:48.623686+0000","last_active":"2024-09-17T03:15:49.776968+0000","last_peered":"2024-09-17T03:15:49.776968+0000","last_clean":"2024-09-17T03:15:49.776968+0000","last_became_active":"2024-09-17T03:15:48.623325+0000","last_became_peered":"2024-09-17T03:15:48.623325+0000","last_unstale":"2024-09-17T03:15:49.776968+0000","last_undegraded":"2024-09-17T03:15:49.776968+0000","last_fullsized":"2024-09-17T03:15:49.776968+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:58.755965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760636+0000","last_change":"2024-09-17T03:15:47.619590+0000","last_active":"2024-09-17T03:15:49.760636+0000","last_peered":"2024-09-17T03:15:49.760636+0000","last_clean":"2024-09-17T03:15:49.760636+0000","last_became_active":"2024-09-17T03:15:47.619278+0000","last_became_peered":"2024-09-17T03:15:47.619278+0000","last_unstale":"2024-09-17T03:15:49.760636+0000","last_undegraded":"2024-09-17T03:15:49.760636+0000","last_fullsized":"2024-09-17T03:15:49.760636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:24.514537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760209+0000","last_change":"2024-09-17T03:15:48.637670+0000","last_active":"2024-09-17T03:15:49.760209+0000","last_peered":"2024-09-17T03:15:49.760209+0000","last_clean":"2024-09-17T03:15:49.760209+0000","last_became_active":"2024-09-17T03:15:48.637374+0000","last_became_peered":"2024-09-17T03:15:48.637374+0000","last_unstale":"2024-09-17T03:15:49.760209+0000","last_undegraded":"2024-09-17T03:15:49.760209+0000","last_fullsized":"2024-09-17T03:15:49.760209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:34.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760523+0000","last_change":"2024-09-17T03:15:47.621140+0000","last_active":"2024-09-17T03:15:49.760523+0000","last_peered":"2024-09-17T03:15:49.760523+0000","last_clean":"2024-09-17T03:15:49.760523+0000","last_became_active":"2024-09-17T03:15:47.620773+0000","last_became_peered":"2024-09-17T03:15:47.620773+0000","last_unstale":"2024-09-17T03:15:49.760523+0000","last_undegraded":"2024-09-17T03:15:49.760523+0000","last_fullsized":"2024-09-17T03:15:49.760523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:00.275162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646774+0000","last_change":"2024-09-17T03:15:48.638826+0000","last_active":"2024-09-17T03:15:48.646774+0000","last_peered":"2024-09-17T03:15:48.646774+0000","last_clean":"2024-09-17T03:15:48.646774+0000","last_became_active":"2024-09-17T03:15:48.638506+0000","last_became_peered":"2024-09-17T03:15:48.638506+0000","last_unstale":"2024-09-17T03:15:48.646774+0000","last_undegraded":"2024-09-17T03:15:48.646774+0000","last_fullsized":"2024-09-17T03:15:48.646774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:06.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120091+0000","last_change":"2024-09-17T03:15:47.625546+0000","last_active":"2024-09-17T03:15:50.120091+0000","last_peered":"2024-09-17T03:15:50.120091+0000","last_clean":"2024-09-17T03:15:50.120091+0000","last_became_active":"2024-09-17T03:15:47.625229+0000","last_became_peered":"2024-09-17T03:15:47.625229+0000","last_unstale":"2024-09-17T03:15:50.120091+0000","last_undegraded":"2024-09-17T03:15:50.120091+0000","last_fullsized":"2024-09-17T03:15:50.120091+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:15.282334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630989+0000","last_change":"2024-09-17T03:15:48.628048+0000","last_active":"2024-09-17T03:15:49.630989+0000","last_peered":"2024-09-17T03:15:49.630989+0000","last_clean":"2024-09-17T03:15:49.630989+0000","last_became_active":"2024-09-17T03:15:48.627505+0000","last_became_peered":"2024-09-17T03:15:48.627505+0000","last_unstale":"2024-09-17T03:15:49.630989+0000","last_undegraded":"2024-09-17T03:15:49.630989+0000","last_fullsized":"2024-09-17T03:15:49.630989+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.968414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120690+0000","last_change":"2024-09-17T03:15:47.632651+0000","last_active":"2024-09-17T03:15:50.120690+0000","last_peered":"2024-09-17T03:15:50.120690+0000","last_clean":"2024-09-17T03:15:50.120690+0000","last_became_active":"2024-09-17T03:15:47.632018+0000","last_became_peered":"2024-09-17T03:15:47.632018+0000","last_unstale":"2024-09-17T03:15:50.120690+0000","last_undegraded":"2024-09-17T03:15:50.120690+0000","last_fullsized":"2024-09-17T03:15:50.120690+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.844230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120177+0000","last_change":"2024-09-17T03:15:48.650067+0000","last_active":"2024-09-17T03:15:50.120177+0000","last_peered":"2024-09-17T03:15:50.120177+0000","last_clean":"2024-09-17T03:15:50.120177+0000","last_became_active":"2024-09-17T03:15:48.649721+0000","last_became_peered":"2024-09-17T03:15:48.649721+0000","last_unstale":"2024-09-17T03:15:50.120177+0000","last_undegraded":"2024-09-17T03:15:50.120177+0000","last_fullsized":"2024-09-17T03:15:50.120177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:00.510051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702017+0000","last_change":"2024-09-17T03:15:47.630879+0000","last_active":"2024-09-17T03:15:49.702017+0000","last_peered":"2024-09-17T03:15:49.702017+0000","last_clean":"2024-09-17T03:15:49.702017+0000","last_became_active":"2024-09-17T03:15:47.630499+0000","last_became_peered":"2024-09-17T03:15:47.630499+0000","last_unstale":"2024-09-17T03:15:49.702017+0000","last_undegraded":"2024-09-17T03:15:49.702017+0000","last_fullsized":"2024-09-17T03:15:49.702017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:04.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.641460+0000","last_change":"2024-09-17T03:15:48.630167+0000","last_active":"2024-09-17T03:15:48.641460+0000","last_peered":"2024-09-17T03:15:48.641460+0000","last_clean":"2024-09-17T03:15:48.641460+0000","last_became_active":"2024-09-17T03:15:48.629777+0000","last_became_peered":"2024-09-17T03:15:48.629777+0000","last_unstale":"2024-09-17T03:15:48.641460+0000","last_undegraded":"2024-09-17T03:15:48.641460+0000","last_fullsized":"2024-09-17T03:15:48.641460+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:17.672023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760611+0000","last_change":"2024-09-17T03:15:47.627918+0000","last_active":"2024-09-17T03:15:49.760611+0000","last_peered":"2024-09-17T03:15:49.760611+0000","last_clean":"2024-09-17T03:15:49.760611+0000","last_became_active":"2024-09-17T03:15:47.627642+0000","last_became_peered":"2024-09-17T03:15:47.627642+0000","last_unstale":"2024-09-17T03:15:49.760611+0000","last_undegraded":"2024-09-17T03:15:49.760611+0000","last_fullsized":"2024-09-17T03:15:49.760611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:46.798908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702332+0000","last_change":"2024-09-17T03:15:48.647163+0000","last_active":"2024-09-17T03:15:49.702332+0000","last_peered":"2024-09-17T03:15:49.702332+0000","last_clean":"2024-09-17T03:15:49.702332+0000","last_became_active":"2024-09-17T03:15:48.646195+0000","last_became_peered":"2024-09-17T03:15:48.646195+0000","last_unstale":"2024-09-17T03:15:49.702332+0000","last_undegraded":"2024-09-17T03:15:49.702332+0000","last_fullsized":"2024-09-17T03:15:49.702332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.813853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630611+0000","last_change":"2024-09-17T03:15:47.618905+0000","last_active":"2024-09-17T03:15:49.630611+0000","last_peered":"2024-09-17T03:15:49.630611+0000","last_clean":"2024-09-17T03:15:49.630611+0000","last_became_active":"2024-09-17T03:15:47.618618+0000","last_became_peered":"2024-09-17T03:15:47.618618+0000","last_unstale":"2024-09-17T03:15:49.630611+0000","last_undegraded":"2024-09-17T03:15:49.630611+0000","last_fullsized":"2024-09-17T03:15:49.630611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:03.055919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630531+0000","last_change":"2024-09-17T03:15:48.623750+0000","last_active":"2024-09-17T03:15:49.630531+0000","last_peered":"2024-09-17T03:15:49.630531+0000","last_clean":"2024-09-17T03:15:49.630531+0000","last_became_active":"2024-09-17T03:15:48.623197+0000","last_became_peered":"2024-09-17T03:15:48.623197+0000","last_unstale":"2024-09-17T03:15:49.630531+0000","last_undegraded":"2024-09-17T03:15:49.630531+0000","last_fullsized":"2024-09-17T03:15:49.630531+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:49.464778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701872+0000","last_change":"2024-09-17T03:15:47.632104+0000","last_active":"2024-09-17T03:15:49.701872+0000","last_peered":"2024-09-17T03:15:49.701872+0000","last_clean":"2024-09-17T03:15:49.701872+0000","last_became_active":"2024-09-17T03:15:47.631772+0000","last_became_peered":"2024-09-17T03:15:47.631772+0000","last_unstale":"2024-09-17T03:15:49.701872+0000","last_undegraded":"2024-09-17T03:15:49.701872+0000","last_fullsized":"2024-09-17T03:15:49.701872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.151080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120229+0000","last_change":"2024-09-17T03:15:48.645669+0000","last_active":"2024-09-17T03:15:50.120229+0000","last_peered":"2024-09-17T03:15:50.120229+0000","last_clean":"2024-09-17T03:15:50.120229+0000","last_became_active":"2024-09-17T03:15:48.645297+0000","last_became_peered":"2024-09-17T03:15:48.645297+0000","last_unstale":"2024-09-17T03:15:50.120229+0000","last_undegraded":"2024-09-17T03:15:50.120229+0000","last_fullsized":"2024-09-17T03:15:50.120229+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:09.269703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702238+0000","last_change":"2024-09-17T03:15:47.632270+0000","last_active":"2024-09-17T03:15:49.702238+0000","last_peered":"2024-09-17T03:15:49.702238+0000","last_clean":"2024-09-17T03:15:49.702238+0000","last_became_active":"2024-09-17T03:15:47.631980+0000","last_became_peered":"2024-09-17T03:15:47.631980+0000","last_unstale":"2024-09-17T03:15:49.702238+0000","last_undegraded":"2024-09-17T03:15:49.702238+0000","last_fullsized":"2024-09-17T03:15:49.702238+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:02.943928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.626512+0000","last_change":"2024-09-17T03:15:48.617733+0000","last_active":"2024-09-17T03:15:48.626512+0000","last_peered":"2024-09-17T03:15:48.626512+0000","last_clean":"2024-09-17T03:15:48.626512+0000","last_became_active":"2024-09-17T03:15:48.617381+0000","last_became_peered":"2024-09-17T03:15:48.617381+0000","last_unstale":"2024-09-17T03:15:48.626512+0000","last_undegraded":"2024-09-17T03:15:48.626512+0000","last_fullsized":"2024-09-17T03:15:48.626512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:17.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702195+0000","last_change":"2024-09-17T03:15:47.630874+0000","last_active":"2024-09-17T03:15:49.702195+0000","last_peered":"2024-09-17T03:15:49.702195+0000","last_clean":"2024-09-17T03:15:49.702195+0000","last_became_active":"2024-09-17T03:15:47.630454+0000","last_became_peered":"2024-09-17T03:15:47.630454+0000","last_unstale":"2024-09-17T03:15:49.702195+0000","last_undegraded":"2024-09-17T03:15:49.702195+0000","last_fullsized":"2024-09-17T03:15:49.702195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:12.130976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630777+0000","last_change":"2024-09-17T03:15:48.652116+0000","last_active":"2024-09-17T03:15:49.630777+0000","last_peered":"2024-09-17T03:15:49.630777+0000","last_clean":"2024-09-17T03:15:49.630777+0000","last_became_active":"2024-09-17T03:15:48.651827+0000","last_became_peered":"2024-09-17T03:15:48.651827+0000","last_unstale":"2024-09-17T03:15:49.630777+0000","last_undegraded":"2024-09-17T03:15:49.630777+0000","last_fullsized":"2024-09-17T03:15:49.630777+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:26.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760327+0000","last_change":"2024-09-17T03:15:47.626965+0000","last_active":"2024-09-17T03:15:49.760327+0000","last_peered":"2024-09-17T03:15:49.760327+0000","last_clean":"2024-09-17T03:15:49.760327+0000","last_became_active":"2024-09-17T03:15:47.626646+0000","last_became_peered":"2024-09-17T03:15:47.626646+0000","last_unstale":"2024-09-17T03:15:49.760327+0000","last_undegraded":"2024-09-17T03:15:49.760327+0000","last_fullsized":"2024-09-17T03:15:49.760327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:54.273982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.701823+0000","last_change":"2024-09-17T03:15:48.644810+0000","last_active":"2024-09-17T03:15:49.701823+0000","last_peered":"2024-09-17T03:15:49.701823+0000","last_clean":"2024-09-17T03:15:49.701823+0000","last_became_active":"2024-09-17T03:15:48.644525+0000","last_became_peered":"2024-09-17T03:15:48.644525+0000","last_unstale":"2024-09-17T03:15:49.701823+0000","last_undegraded":"2024-09-17T03:15:49.701823+0000","last_fullsized":"2024-09-17T03:15:49.701823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:40.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631542+0000","last_change":"2024-09-17T03:15:47.623656+0000","last_active":"2024-09-17T03:15:49.631542+0000","last_peered":"2024-09-17T03:15:49.631542+0000","last_clean":"2024-09-17T03:15:49.631542+0000","last_became_active":"2024-09-17T03:15:47.623315+0000","last_became_peered":"2024-09-17T03:15:47.623315+0000","last_unstale":"2024-09-17T03:15:49.631542+0000","last_undegraded":"2024-09-17T03:15:49.631542+0000","last_fullsized":"2024-09-17T03:15:49.631542+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:44.921511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631471+0000","last_change":"2024-09-17T03:15:48.646431+0000","last_active":"2024-09-17T03:15:49.631471+0000","last_peered":"2024-09-17T03:15:49.631471+0000","last_clean":"2024-09-17T03:15:49.631471+0000","last_became_active":"2024-09-17T03:15:48.646156+0000","last_became_peered":"2024-09-17T03:15:48.646156+0000","last_unstale":"2024-09-17T03:15:49.631471+0000","last_undegraded":"2024-09-17T03:15:49.631471+0000","last_fullsized":"2024-09-17T03:15:49.631471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:22.316164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.641859+0000","last_change":"2024-09-17T03:15:47.628349+0000","last_active":"2024-09-17T03:15:48.641859+0000","last_peered":"2024-09-17T03:15:48.641859+0000","last_clean":"2024-09-17T03:15:48.641859+0000","last_became_active":"2024-09-17T03:15:47.628005+0000","last_became_peered":"2024-09-17T03:15:47.628005+0000","last_unstale":"2024-09-17T03:15:48.641859+0000","last_undegraded":"2024-09-17T03:15:48.641859+0000","last_fullsized":"2024-09-17T03:15:48.641859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:19.315776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760445+0000","last_change":"2024-09-17T03:15:48.630636+0000","last_active":"2024-09-17T03:15:49.760445+0000","last_peered":"2024-09-17T03:15:49.760445+0000","last_clean":"2024-09-17T03:15:49.760445+0000","last_became_active":"2024-09-17T03:15:48.630384+0000","last_became_peered":"2024-09-17T03:15:48.630384+0000","last_unstale":"2024-09-17T03:15:49.760445+0000","last_undegraded":"2024-09-17T03:15:49.760445+0000","last_fullsized":"2024-09-17T03:15:49.760445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:33.632359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630117+0000","last_change":"2024-09-17T03:15:47.626570+0000","last_active":"2024-09-17T03:15:49.630117+0000","last_peered":"2024-09-17T03:15:49.630117+0000","last_clean":"2024-09-17T03:15:49.630117+0000","last_became_active":"2024-09-17T03:15:47.626273+0000","last_became_peered":"2024-09-17T03:15:47.626273+0000","last_unstale":"2024-09-17T03:15:49.630117+0000","last_undegraded":"2024-09-17T03:15:49.630117+0000","last_fullsized":"2024-09-17T03:15:49.630117+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:48.187307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:15:48.646863+0000","last_change":"2024-09-17T03:15:48.638592+0000","last_active":"2024-09-17T03:15:48.646863+0000","last_peered":"2024-09-17T03:15:48.646863+0000","last_clean":"2024-09-17T03:15:48.646863+0000","last_became_active":"2024-09-17T03:15:48.638188+0000","last_became_peered":"2024-09-17T03:15:48.638188+0000","last_unstale":"2024-09-17T03:15:48.646863+0000","last_undegraded":"2024-09-17T03:15:48.646863+0000","last_fullsized":"2024-09-17T03:15:48.646863+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.020557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120099+0000","last_change":"2024-09-17T03:15:47.625570+0000","last_active":"2024-09-17T03:15:50.120099+0000","last_peered":"2024-09-17T03:15:50.120099+0000","last_clean":"2024-09-17T03:15:50.120099+0000","last_became_active":"2024-09-17T03:15:47.625183+0000","last_became_peered":"2024-09-17T03:15:47.625183+0000","last_unstale":"2024-09-17T03:15:50.120099+0000","last_undegraded":"2024-09-17T03:15:50.120099+0000","last_fullsized":"2024-09-17T03:15:50.120099+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:42.594521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702347+0000","last_change":"2024-09-17T03:15:48.647526+0000","last_active":"2024-09-17T03:15:49.702347+0000","last_peered":"2024-09-17T03:15:49.702347+0000","last_clean":"2024-09-17T03:15:49.702347+0000","last_became_active":"2024-09-17T03:15:48.645428+0000","last_became_peered":"2024-09-17T03:15:48.645428+0000","last_unstale":"2024-09-17T03:15:49.702347+0000","last_undegraded":"2024-09-17T03:15:49.702347+0000","last_fullsized":"2024-09-17T03:15:49.702347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:56.293101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120174+0000","last_change":"2024-09-17T03:15:47.627338+0000","last_active":"2024-09-17T03:15:50.120174+0000","last_peered":"2024-09-17T03:15:50.120174+0000","last_clean":"2024-09-17T03:15:50.120174+0000","last_became_active":"2024-09-17T03:15:47.626848+0000","last_became_peered":"2024-09-17T03:15:47.626848+0000","last_unstale":"2024-09-17T03:15:50.120174+0000","last_undegraded":"2024-09-17T03:15:50.120174+0000","last_fullsized":"2024-09-17T03:15:50.120174+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:33.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760179+0000","last_change":"2024-09-17T03:15:48.623671+0000","last_active":"2024-09-17T03:15:49.760179+0000","last_peered":"2024-09-17T03:15:49.760179+0000","last_clean":"2024-09-17T03:15:49.760179+0000","last_became_active":"2024-09-17T03:15:48.623378+0000","last_became_peered":"2024-09-17T03:15:48.623378+0000","last_unstale":"2024-09-17T03:15:49.760179+0000","last_undegraded":"2024-09-17T03:15:49.760179+0000","last_fullsized":"2024-09-17T03:15:49.760179+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:22.919426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120109+0000","last_change":"2024-09-17T03:15:47.630012+0000","last_active":"2024-09-17T03:15:50.120109+0000","last_peered":"2024-09-17T03:15:50.120109+0000","last_clean":"2024-09-17T03:15:50.120109+0000","last_became_active":"2024-09-17T03:15:47.629613+0000","last_became_peered":"2024-09-17T03:15:47.629613+0000","last_unstale":"2024-09-17T03:15:50.120109+0000","last_undegraded":"2024-09-17T03:15:50.120109+0000","last_fullsized":"2024-09-17T03:15:50.120109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:19.097209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120267+0000","last_change":"2024-09-17T03:15:48.641981+0000","last_active":"2024-09-17T03:15:50.120267+0000","last_peered":"2024-09-17T03:15:50.120267+0000","last_clean":"2024-09-17T03:15:50.120267+0000","last_became_active":"2024-09-17T03:15:48.639767+0000","last_became_peered":"2024-09-17T03:15:48.639767+0000","last_unstale":"2024-09-17T03:15:50.120267+0000","last_undegraded":"2024-09-17T03:15:50.120267+0000","last_fullsized":"2024-09-17T03:15:50.120267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.631768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120172+0000","last_change":"2024-09-17T03:15:47.625406+0000","last_active":"2024-09-17T03:15:50.120172+0000","last_peered":"2024-09-17T03:15:50.120172+0000","last_clean":"2024-09-17T03:15:50.120172+0000","last_became_active":"2024-09-17T03:15:47.625121+0000","last_became_peered":"2024-09-17T03:15:47.625121+0000","last_unstale":"2024-09-17T03:15:50.120172+0000","last_undegraded":"2024-09-17T03:15:50.120172+0000","last_fullsized":"2024-09-17T03:15:50.120172+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:59.292954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630313+0000","last_change":"2024-09-17T03:15:48.636291+0000","last_active":"2024-09-17T03:15:49.630313+0000","last_peered":"2024-09-17T03:15:49.630313+0000","last_clean":"2024-09-17T03:15:49.630313+0000","last_became_active":"2024-09-17T03:15:48.635108+0000","last_became_peered":"2024-09-17T03:15:48.635108+0000","last_unstale":"2024-09-17T03:15:49.630313+0000","last_undegraded":"2024-09-17T03:15:49.630313+0000","last_fullsized":"2024-09-17T03:15:49.630313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:07.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629447+0000","last_change":"2024-09-17T03:15:47.624562+0000","last_active":"2024-09-17T03:15:49.629447+0000","last_peered":"2024-09-17T03:15:49.629447+0000","last_clean":"2024-09-17T03:15:49.629447+0000","last_became_active":"2024-09-17T03:15:47.624023+0000","last_became_peered":"2024-09-17T03:15:47.624023+0000","last_unstale":"2024-09-17T03:15:49.629447+0000","last_undegraded":"2024-09-17T03:15:49.629447+0000","last_fullsized":"2024-09-17T03:15:49.629447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:58.643244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120623+0000","last_change":"2024-09-17T03:15:48.644328+0000","last_active":"2024-09-17T03:15:50.120623+0000","last_peered":"2024-09-17T03:15:50.120623+0000","last_clean":"2024-09-17T03:15:50.120623+0000","last_became_active":"2024-09-17T03:15:48.642543+0000","last_became_peered":"2024-09-17T03:15:48.642543+0000","last_unstale":"2024-09-17T03:15:50.120623+0000","last_undegraded":"2024-09-17T03:15:50.120623+0000","last_fullsized":"2024-09-17T03:15:50.120623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:52.338692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120435+0000","last_change":"2024-09-17T03:15:47.629462+0000","last_active":"2024-09-17T03:15:50.120435+0000","last_peered":"2024-09-17T03:15:50.120435+0000","last_clean":"2024-09-17T03:15:50.120435+0000","last_became_active":"2024-09-17T03:15:47.629016+0000","last_became_peered":"2024-09-17T03:15:47.629016+0000","last_unstale":"2024-09-17T03:15:50.120435+0000","last_undegraded":"2024-09-17T03:15:50.120435+0000","last_fullsized":"2024-09-17T03:15:50.120435+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.698885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.631430+0000","last_change":"2024-09-17T03:15:48.644919+0000","last_active":"2024-09-17T03:15:49.631430+0000","last_peered":"2024-09-17T03:15:49.631430+0000","last_clean":"2024-09-17T03:15:49.631430+0000","last_became_active":"2024-09-17T03:15:48.644648+0000","last_became_peered":"2024-09-17T03:15:48.644648+0000","last_unstale":"2024-09-17T03:15:49.631430+0000","last_undegraded":"2024-09-17T03:15:49.631430+0000","last_fullsized":"2024-09-17T03:15:49.631430+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:56.293101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.629678+0000","last_change":"2024-09-17T03:15:47.626840+0000","last_active":"2024-09-17T03:15:49.629678+0000","last_peered":"2024-09-17T03:15:49.629678+0000","last_clean":"2024-09-17T03:15:49.629678+0000","last_became_active":"2024-09-17T03:15:47.626525+0000","last_became_peered":"2024-09-17T03:15:47.626525+0000","last_unstale":"2024-09-17T03:15:49.629678+0000","last_undegraded":"2024-09-17T03:15:49.629678+0000","last_fullsized":"2024-09-17T03:15:49.629678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:04.579860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.120852+0000","last_change":"2024-09-17T03:15:48.644492+0000","last_active":"2024-09-17T03:15:50.120852+0000","last_peered":"2024-09-17T03:15:50.120852+0000","last_clean":"2024-09-17T03:15:50.120852+0000","last_became_active":"2024-09-17T03:15:48.640615+0000","last_became_peered":"2024-09-17T03:15:48.640615+0000","last_unstale":"2024-09-17T03:15:50.120852+0000","last_undegraded":"2024-09-17T03:15:50.120852+0000","last_fullsized":"2024-09-17T03:15:50.120852+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:20.377681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.630712+0000","last_change":"2024-09-17T03:15:47.619649+0000","last_active":"2024-09-17T03:15:49.630712+0000","last_peered":"2024-09-17T03:15:49.630712+0000","last_clean":"2024-09-17T03:15:49.630712+0000","last_became_active":"2024-09-17T03:15:47.619327+0000","last_became_peered":"2024-09-17T03:15:47.619327+0000","last_unstale":"2024-09-17T03:15:49.630712+0000","last_undegraded":"2024-09-17T03:15:49.630712+0000","last_fullsized":"2024-09-17T03:15:49.630712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:22.026498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.702129+0000","last_change":"2024-09-17T03:15:48.647585+0000","last_active":"2024-09-17T03:15:49.702129+0000","last_peered":"2024-09-17T03:15:49.702129+0000","last_clean":"2024-09-17T03:15:49.702129+0000","last_became_active":"2024-09-17T03:15:48.647202+0000","last_became_peered":"2024-09-17T03:15:48.647202+0000","last_unstale":"2024-09-17T03:15:49.702129+0000","last_undegraded":"2024-09-17T03:15:49.702129+0000","last_fullsized":"2024-09-17T03:15:49.702129+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.968414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.759977+0000","last_change":"2024-09-17T03:15:47.628535+0000","last_active":"2024-09-17T03:15:49.759977+0000","last_peered":"2024-09-17T03:15:49.759977+0000","last_clean":"2024-09-17T03:15:49.759977+0000","last_became_active":"2024-09-17T03:15:47.628167+0000","last_became_peered":"2024-09-17T03:15:47.628167+0000","last_unstale":"2024-09-17T03:15:49.759977+0000","last_undegraded":"2024-09-17T03:15:49.759977+0000","last_fullsized":"2024-09-17T03:15:49.759977+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:58.104495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.777030+0000","last_change":"2024-09-17T03:15:48.626698+0000","last_active":"2024-09-17T03:15:49.777030+0000","last_peered":"2024-09-17T03:15:49.777030+0000","last_clean":"2024-09-17T03:15:49.777030+0000","last_became_active":"2024-09-17T03:15:48.626410+0000","last_became_peered":"2024-09-17T03:15:48.626410+0000","last_unstale":"2024-09-17T03:15:49.777030+0000","last_undegraded":"2024-09-17T03:15:49.777030+0000","last_fullsized":"2024-09-17T03:15:49.777030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:47.596261+0000","last_clean_scrub_stamp":"2024-09-17T03:15:47.596261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:17.555955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"58'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:50.613372+0000","last_change":"2024-09-17T03:15:47.625794+0000","last_active":"2024-09-17T03:15:50.613372+0000","last_peered":"2024-09-17T03:15:50.613372+0000","last_clean":"2024-09-17T03:15:50.613372+0000","last_became_active":"2024-09-17T03:15:47.625428+0000","last_became_peered":"2024-09-17T03:15:47.625428+0000","last_unstale":"2024-09-17T03:15:50.613372+0000","last_undegraded":"2024-09-17T03:15:50.613372+0000","last_fullsized":"2024-09-17T03:15:50.613372+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:15:46.593482+0000","last_clean_scrub_stamp":"2024-09-17T03:15:46.593482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:51.218844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":173,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:15:49.760124+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:15:49.760124+0000","last_peered":"2024-09-17T03:15:49.760124+0000","last_clean":"2024-09-17T03:15:49.760124+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:15:49.760124+0000","last_undegraded":"2024-09-17T03:15:49.760124+0000","last_fullsized":"2024-09-17T03:15:49.760124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":692224,"data_stored":307767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1294336,"data_stored":899781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":704512,"data_stored":309415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":307801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":307745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":898149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":308293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":301601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:53.541 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:15:53.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 -- 172.21.15.153:0/408478566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4638003c80 msgr2=0x7f46380040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 --2- 172.21.15.153:0/408478566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4638003c80 0x7f46380040d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4644001850 tx=0x7f4638005830 comp rx=0 tx=0).stop 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4653e00640 1 -- 172.21.15.153:0/408478566 reap_dead start 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 -- 172.21.15.153:0/408478566 shutdown_connections 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 -- 172.21.15.153:0/408478566 >> 172.21.15.153:0/408478566 conn(0x7f46540cff30 msgr2=0x7f46540d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 -- 172.21.15.153:0/408478566 shutdown_connections 2024-09-17T03:15:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.809+0000 7f4659000640 1 -- 172.21.15.153:0/408478566 wait complete. 2024-09-17T03:15:53.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.812+0000 7f4659000640 1 Processor -- start 2024-09-17T03:15:53.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.812+0000 7f4659000640 1 -- start start 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4638003c80 0x7f465409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f465409aa70 0x7f46540cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f465406f760 con 0x7f465415b420 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4654074d70 con 0x7f465409aa70 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4659000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f465406f8e0 con 0x7f4638003c80 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.813+0000 7f4653e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50156/0 (socket says 172.21.15.153:50156) 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 -- 172.21.15.153:0/3638199228 learned_addr learned my addr 172.21.15.153:0/3638199228 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4652a00640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f465409aa70 0x7f46540cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653400640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4638003c80 0x7f465409b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 -- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4638003c80 msgr2=0x7f465409b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4638003c80 0x7f465409b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 -- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f465409aa70 msgr2=0x7f46540cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f465409aa70 0x7f46540cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 -- 172.21.15.153:0/3638199228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46541f8e90 con 0x7f465415b420 2024-09-17T03:15:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f4653e00640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f465415d930 tx=0x7f464c006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.814+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c00f9a0 con 0x7f465415b420 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.815+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f464c018070 con 0x7f465415b420 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.815+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c00fe20 con 0x7f465415b420 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.815+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465415bd70 con 0x7f465415b420 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.815+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46541f9100 con 0x7f465415b420 2024-09-17T03:15:53.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.816+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46541f9b00 con 0x7f465415b420 2024-09-17T03:15:53.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.817+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f464c01d460 con 0x7f465415b420 2024-09-17T03:15:53.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.818+0000 7f464b400640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 0x7f463407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:53.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.818+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7f464c09b290 con 0x7f465415b420 2024-09-17T03:15:53.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.818+0000 7f4653400640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 0x7f463407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:53.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.820+0000 7f4653400640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 0x7f463407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4654074260 tx=0x7f46440013b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:53.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:53.823+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f465415bd70 con 0x7f465415b420 2024-09-17T03:15:54.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.075+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f46540b5eb0 con 0x7f465415b420 2024-09-17T03:15:54.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.078+0000 7f464b400640 1 -- 172.21.15.153:0/3638199228 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f464c063540 con 0x7f465415b420 2024-09-17T03:15:54.077 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-17T03:15:54.077 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCa8+hmC2quOhAAd67qiXr37cGbxUf9InzGtQ== 2024-09-17T03:15:54.077 INFO:teuthology.orchestra.run.smithi153.stdout: caps mds = "allow" 2024-09-17T03:15:54.077 INFO:teuthology.orchestra.run.smithi153.stdout: caps mon = "allow r" 2024-09-17T03:15:54.078 INFO:teuthology.orchestra.run.smithi153.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:15:54.078 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2024-09-17T03:15:54.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 msgr2=0x7f463407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 0x7f463407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4654074260 tx=0x7f46440013b0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 msgr2=0x7f465415b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f465415d930 tx=0x7f464c006660 comp rx=0 tx=0).stop 2024-09-17T03:15:54.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 shutdown_connections 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4634078b90 0x7f463407b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f465415b420 0x7f465415b830 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f465409aa70 0x7f46540cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 --2- 172.21.15.153:0/3638199228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4638003c80 0x7f465409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 >> 172.21.15.153:0/3638199228 conn(0x7f46540cff30 msgr2=0x7f46540b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 shutdown_connections 2024-09-17T03:15:54.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.081+0000 7f4659000640 1 -- 172.21.15.153:0/3638199228 wait complete. 2024-09-17T03:15:54.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 -- 172.21.15.153:0/69634808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 msgr2=0x7fbeb00caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/69634808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb00caf20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea802aa10 comp rx=0 tx=0).stop 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 -- 172.21.15.153:0/69634808 shutdown_connections 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/69634808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb00caf20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/69634808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 0x7fbeb006ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 -- 172.21.15.153:0/69634808 >> 172.21.15.153:0/69634808 conn(0x7fbeb00d0070 msgr2=0x7fbeb00d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 -- 172.21.15.153:0/69634808 shutdown_connections 2024-09-17T03:15:54.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.324+0000 7fbeb5a00640 1 -- 172.21.15.153:0/69634808 wait complete. 2024-09-17T03:15:54.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.327+0000 7fbeb5a00640 1 Processor -- start 2024-09-17T03:15:54.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.327+0000 7fbeb5a00640 1 -- start start 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 0x7fbeb01f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbeb015c790 0x7fbeb01f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb00cb8a0 con 0x7fbeb006f180 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb00cb720 con 0x7fbeb015c790 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeb5a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb00cba20 con 0x7fbeb0073e20 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeaea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.328+0000 7fbeaea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50168/0 (socket says 172.21.15.153:50168) 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 -- 172.21.15.153:0/1528922654 learned_addr learned my addr 172.21.15.153:0/1528922654 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbea6000640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 0x7fbeb01f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaf400640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbeb015c790 0x7fbeb01f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 -- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 msgr2=0x7fbeb01f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 0x7fbeb01f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 -- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbeb015c790 msgr2=0x7fbeb01f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbeb015c790 0x7fbeb01f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 -- 172.21.15.153:0/1528922654 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb009d4f0 con 0x7fbeb006f180 2024-09-17T03:15:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.329+0000 7fbeaea00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c3a0 tx=0x7fbea000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.330+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0017070 con 0x7fbeb006f180 2024-09-17T03:15:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.330+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbea00053c0 con 0x7fbeb006f180 2024-09-17T03:15:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.330+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb009cc50 con 0x7fbeb006f180 2024-09-17T03:15:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.330+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0003850 con 0x7fbeb006f180 2024-09-17T03:15:54.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.330+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb009d210 con 0x7fbeb006f180 2024-09-17T03:15:54.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.331+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb009e230 con 0x7fbeb006f180 2024-09-17T03:15:54.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.332+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbea001a070 con 0x7fbeb006f180 2024-09-17T03:15:54.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.333+0000 7fbea7400640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 0x7fbe8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:54.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.333+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fbea009a1b0 con 0x7fbeb006f180 2024-09-17T03:15:54.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.334+0000 7fbea6000640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 0x7fbe8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:54.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.334+0000 7fbea6000640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 0x7fbe8c07b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0156730 tx=0x7fbe98005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:54.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.337+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbeb009e230 con 0x7fbeb006f180 2024-09-17T03:15:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.556+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeb009c750 con 0x7fbeb006f180 2024-09-17T03:15:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.557+0000 7fbea7400640 1 -- 172.21.15.153:0/1528922654 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fbeb006f590 con 0x7fbeb006f180 2024-09-17T03:15:54.556 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:54.556 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"btime":"2024-09-17T03:15:51:637193+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3522404014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3522404014},{"type":"v1","addr":"172.21.15.164:6836","nonce":3522404014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2004529324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":2004529324},{"type":"v1","addr":"172.21.15.164:6837","nonce":2004529324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4173553541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4173553541},{"type":"v1","addr":"172.21.15.153:6835","nonce":4173553541}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:15:51.118681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1746730417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1746730417},{"type":"v1","addr":"172.21.15.153:6834","nonce":1746730417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5433,"qdb_cluster":[5433]},"id":3}]} 2024-09-17T03:15:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 34 2024-09-17T03:15:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 msgr2=0x7fbe8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 0x7fbe8c07b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0156730 tx=0x7fbe98005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 msgr2=0x7fbeb015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c3a0 tx=0x7fbea000c860 comp rx=0 tx=0).stop 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 shutdown_connections 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbe8c078b90 0x7fbe8c07b0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbeb015c790 0x7fbeb01f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbeb0073e20 0x7fbeb01f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 --2- 172.21.15.153:0/1528922654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbeb006f180 0x7fbeb015f710 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 >> 172.21.15.153:0/1528922654 conn(0x7fbeb00d0070 msgr2=0x7fbeb00af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 shutdown_connections 2024-09-17T03:15:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:54.559+0000 7fbeb5a00640 1 -- 172.21.15.153:0/1528922654 wait complete. 2024-09-17T03:15:54.577 INFO:tasks.ceph.mds.a.smithi153.stderr:2024-09-17T03:15:54.578+0000 7f63e0400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:15:54.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:15:48.101975+0000', 'modified': '2024-09-17T03:15:51.118681+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6834/1746730417', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1746730417}, {'type': 'v1', 'addr': '172.21.15.153:6834', 'nonce': 1746730417}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5433, 'qdb_cluster': [5433]} 2024-09-17T03:15:54.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:15:54.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 -- 172.21.15.153:0/353905151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc003ac0 msgr2=0x7fb0dc003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 --2- 172.21.15.153:0/353905151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc003ac0 0x7fb0dc003f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8001690 tx=0x7fb0dc005830 comp rx=0 tx=0).stop 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 -- 172.21.15.153:0/353905151 shutdown_connections 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 --2- 172.21.15.153:0/353905151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0dc003ac0 0x7fb0dc003f30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 -- 172.21.15.153:0/353905151 >> 172.21.15.153:0/353905151 conn(0x7fb0f80d0070 msgr2=0x7fb0f80d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 -- 172.21.15.153:0/353905151 shutdown_connections 2024-09-17T03:15:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.211+0000 7fb0ff000640 1 -- 172.21.15.153:0/353905151 wait complete. 2024-09-17T03:15:55.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.214+0000 7fb0ff000640 1 Processor -- start 2024-09-17T03:15:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.214+0000 7fb0ff000640 1 -- start start 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0dc003ac0 0x7fb0f8146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f809d350 0x7fb0f80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f806ec40 con 0x7fb0f809cf40 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8074de0 con 0x7fb0dc003ac0 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ff000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f806edc0 con 0x7fb0f809d350 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.215+0000 7fb0ef400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50172/0 (socket says 172.21.15.153:50172) 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 -- 172.21.15.153:0/3919088302 learned_addr learned my addr 172.21.15.153:0/3919088302 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0fd000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f809d350 0x7fb0f80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 -- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f809d350 msgr2=0x7fb0f80b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f809d350 0x7fb0f80b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0dc003ac0 0x7fb0f8146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 -- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0dc003ac0 msgr2=0x7fb0f8146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0dc003ac0 0x7fb0f8146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 -- 172.21.15.153:0/3919088302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f81f2e50 con 0x7fb0f809cf40 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000e590 tx=0x7fb0e000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.216+0000 7fb0f4c00640 1 -- 172.21.15.153:0/3919088302 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0015070 con 0x7fb0f809cf40 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.217+0000 7fb0f4c00640 1 -- 172.21.15.153:0/3919088302 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e0010980 con 0x7fb0f809cf40 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.217+0000 7fb0f4c00640 1 -- 172.21.15.153:0/3919088302 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0010db0 con 0x7fb0f809cf40 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.217+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f81f3130 con 0x7fb0f809cf40 2024-09-17T03:15:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.217+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f81f36f0 con 0x7fb0f809cf40 2024-09-17T03:15:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.219+0000 7fb0f4c00640 1 -- 172.21.15.153:0/3919088302 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0e0018070 con 0x7fb0f809cf40 2024-09-17T03:15:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.220+0000 7fb0f4c00640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 0x7fb0d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.220+0000 7fb0f4c00640 1 -- 172.21.15.153:0/3919088302 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fb0e009b250 con 0x7fb0f809cf40 2024-09-17T03:15:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.221+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 0x7fb0d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.221+0000 7fb10622e740 1 Processor -- start 2024-09-17T03:15:55.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.221+0000 7fb10622e740 1 -- start start 2024-09-17T03:15:55.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.221+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 0x7fb0d407b0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8032000 tx=0x7fb0e8001190 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f35809270 0x557f35bd9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e03b0 0x557f35bd9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f35b33430 con 0x557f357e8590 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557f35b235d0 con 0x557f35809270 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x557f35b12a00 con 0x557f357e03b0 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50174/0 (socket says 172.21.15.153:50174) 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 -- 172.21.15.153:0/2598973329 learned_addr learned my addr 172.21.15.153:0/2598973329 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f35809270 0x557f35bd9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0ef400640 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e03b0 0x557f35bd9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 -- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e03b0 msgr2=0x557f35bd9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e03b0 0x557f35bd9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 -- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f35809270 msgr2=0x557f35bd9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f35809270 0x557f35bd9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.223+0000 7fb0fd000640 1 -- 172.21.15.153:0/2598973329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f35adb520 con 0x557f357e8590 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.224+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80caa40 tx=0x7fb0f0009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814bd9f73078b691 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.224+0000 7fb0ecc00640 1 -- 172.21.15.153:0/2598973329 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0004570 con 0x557f357e8590 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.224+0000 7fb0ecc00640 1 -- 172.21.15.153:0/2598973329 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0f0016070 con 0x557f357e8590 2024-09-17T03:15:55.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.224+0000 7fb0ecc00640 1 -- 172.21.15.153:0/2598973329 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0004b20 con 0x557f357e8590 2024-09-17T03:15:55.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 -- 172.21.15.153:0/2598973329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 msgr2=0x557f35ba9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80caa40 tx=0x7fb0f0009cb0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 -- 172.21.15.153:0/2598973329 shutdown_connections 2024-09-17T03:15:55.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e8590 0x557f35ba9f60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e03b0 0x557f35bd9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 --2- 172.21.15.153:0/2598973329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f35809270 0x557f35bd9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 -- 172.21.15.153:0/2598973329 >> 172.21.15.153:0/2598973329 conn(0x557f357fd3c0 msgr2=0x557f35baf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 -- 172.21.15.153:0/2598973329 shutdown_connections 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.225+0000 7fb10622e740 1 -- 172.21.15.153:0/2598973329 wait complete. 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.226+0000 7fb10622e740 1 -- start start 2024-09-17T03:15:55.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.226+0000 7fb10622e740 1 Processor -- start 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35bef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f35ab9330 con 0x557f35809270 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557f35b16810 con 0x557f357e03b0 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x557f35883620 con 0x557f357e8590 2024-09-17T03:15:55.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb10622e740 10 client.0 _ll_register_callbacks cb 0x557f35abe420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50178/0 (socket says 172.21.15.153:50178) 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 -- 172.21.15.153:0/2149496008 learned_addr learned my addr 172.21.15.153:0/2149496008 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35bef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0ef400640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 -- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 msgr2=0x557f35c079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 -- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 msgr2=0x557f35bef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35bef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0fd000640 1 -- 172.21.15.153:0/2149496008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f35874850 con 0x557f35809270 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35bef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.228+0000 7fb0ef400640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:55.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005fd0 tx=0x7fb0f00129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91020e8bf848ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0e5600640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0004570 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fb0f0009de0 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0f0016070 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb0f002e050 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb10622e740 10 client.5559 fetch_fsmap learned FSMap version 34 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x557f358eb6b0 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.229+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0f0016070 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fb0f0031020 con 0x557f35809270 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 10 client.5559 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 10 client.5559 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 20 client.5559 populate_metadata read hostname 'smithi153' 2024-09-17T03:15:55.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f357c7e40 0x557f35bd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 4 client.5559 mds_command: new command op to 5433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:55.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 --> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f35b25520 con 0x557f357c7e40 2024-09-17T03:15:55.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.230+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f357c7e40 0x557f35bd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.231+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f357c7e40 0x557f35bd52c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b7b8cd32ae5900 server_cookie=85ef88c54a3cacdf in_seq=0 out_seq=0 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.231+0000 7fb0e5600640 10 client.5559 ms_handle_connect on v2:172.21.15.153:6832/1746730417 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.231+0000 7fb0e5600640 1 -- 172.21.15.153:0/2149496008 <== mds.0 v2:172.21.15.153:6832/1746730417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f35b25520 con 0x557f357c7e40 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.231+0000 7fb0e5600640 10 client.5559 handle_command_reply: tid=0 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.231+0000 7fb10622e740 1 client.5559 shutdown 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 msgr2=0x557f35bc3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005fd0 tx=0x7fb0f00129d0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 shutdown_connections 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f357c7e40 0x557f35bd52c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35bc3f10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 --2- 172.21.15.153:0/2149496008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35bef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb0e5600640 0 client.5559 ms_handle_reset on v2:172.21.15.153:6832/1746730417 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 >> 172.21.15.153:0/2149496008 conn(0x557f357fd3c0 msgr2=0x557f35bab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 shutdown_connections 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 1 -- 172.21.15.153:0/2149496008 wait complete. 2024-09-17T03:15:55.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.232+0000 7fb10622e740 20 client.5559 trim_cache size 0 max 16384 2024-09-17T03:15:55.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.251+0000 7fb10622e740 1 Processor -- start 2024-09-17T03:15:55.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.251+0000 7fb10622e740 1 -- start start 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35c02de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c03320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81ff4d0 con 0x557f35809270 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81fe830 con 0x557f357e03b0 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f81fee80 con 0x557f357e8590 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb0fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50188/0 (socket says 172.21.15.153:50188) 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.252+0000 7fb0fd000640 1 -- 172.21.15.153:0/2369325613 learned_addr learned my addr 172.21.15.153:0/2369325613 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35c02de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0ef400640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c03320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 -- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 msgr2=0x557f35c03320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c03320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 -- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 msgr2=0x557f35c02de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35c02de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 -- 172.21.15.153:0/2369325613 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f35bad4e0 con 0x557f35809270 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35c02de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0ef400640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:55.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0fd000640 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00096f0 tx=0x7fb0f0004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c4b0f7b36d88c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0e7e00640 1 -- 172.21.15.153:0/2369325613 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0009de0 con 0x557f35809270 2024-09-17T03:15:55.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0e7e00640 1 -- 172.21.15.153:0/2369325613 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0f0016030 con 0x557f35809270 2024-09-17T03:15:55.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.253+0000 7fb0e7e00640 1 -- 172.21.15.153:0/2369325613 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f001a680 con 0x557f35809270 2024-09-17T03:15:55.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 -- 172.21.15.153:0/2369325613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 msgr2=0x557f35c05a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00096f0 tx=0x7fb0f0004620 comp rx=0 tx=0).stop 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 -- 172.21.15.153:0/2369325613 shutdown_connections 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f35809270 0x557f35c05a40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f357e8590 0x557f35c03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 --2- 172.21.15.153:0/2369325613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e03b0 0x557f35c02de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 -- 172.21.15.153:0/2369325613 >> 172.21.15.153:0/2369325613 conn(0x557f357fd3c0 msgr2=0x557f35bf0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 -- 172.21.15.153:0/2369325613 shutdown_connections 2024-09-17T03:15:55.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.254+0000 7fb10622e740 1 -- 172.21.15.153:0/2369325613 wait complete. 2024-09-17T03:15:55.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.255+0000 7fb10622e740 1 -- start start 2024-09-17T03:15:55.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.255+0000 7fb10622e740 1 Processor -- start 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 0x557f35bd9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 0x557f35bf61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f35bef1b0 con 0x557f357e03b0 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557f35c07ee0 con 0x557f357e8590 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x557f35bd3030 con 0x557f35809270 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb10622e740 10 client.0 _ll_register_callbacks cb 0x7fb0f0003d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50192/0 (socket says 172.21.15.153:50192) 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 -- 172.21.15.153:0/3998034248 learned_addr learned my addr 172.21.15.153:0/3998034248 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0fd000640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 0x557f35bf61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 0x557f35bd9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 -- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 msgr2=0x557f35bf61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 0x557f35bf61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 -- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 msgr2=0x557f35bd9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.257+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 0x557f35bd9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0f7e00640 1 -- 172.21.15.153:0/3998034248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f35bd3e60 con 0x557f357e03b0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0fd000640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 0x557f35bf61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 0x557f35bd9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0f7e00640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0e802a8e0 tx=0x7fb0dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a703793d0e18c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0e5600640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8058060 con 0x557f357e03b0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fb0e80039d0 con 0x557f357e03b0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0f0016030 con 0x557f357e03b0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb0e805e050 con 0x557f357e03b0 2024-09-17T03:15:55.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb10622e740 10 client.5565 fetch_fsmap learned FSMap version 34 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.258+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x557f35c17c60 con 0x557f357e03b0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0f0016030 con 0x557f357e03b0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fb0e8061020 con 0x557f357e03b0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 10 client.5565 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 10 client.5565 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 20 client.5565 populate_metadata read hostname 'smithi153' 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f35bf68b0 0x557f35c06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 4 client.5565 mds_command: new command op to 5433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 --> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] -- command(tid 0: {"prefix": "status"}) -- 0x557f35b20fd0 con 0x557f35bf68b0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.259+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f35bf68b0 0x557f35c06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb0ef400640 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f35bf68b0 0x557f35c06ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c17fdd2bdd26880b server_cookie=1478ffdd55e8a52e in_seq=0 out_seq=0 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb0e5600640 10 client.5565 ms_handle_connect on v2:172.21.15.153:6832/1746730417 2024-09-17T03:15:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb0e5600640 1 -- 172.21.15.153:0/3998034248 <== mds.0 v2:172.21.15.153:6832/1746730417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x557f35b20fd0 con 0x557f35bf68b0 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb0e5600640 10 client.5565 handle_command_reply: tid=0 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 client.5565 shutdown 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 msgr2=0x557f35c6f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0e802a8e0 tx=0x7fb0dc005830 comp rx=0 tx=0).stop 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 shutdown_connections 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:6832/1746730417,v1:172.21.15.153:6834/1746730417] conn(0x557f35bf68b0 0x557f35c06ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x557f35809270 0x557f35bf61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f357e8590 0x557f35bd9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb0e5600640 0 client.5565 ms_handle_reset on v2:172.21.15.153:6832/1746730417 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 --2- 172.21.15.153:0/3998034248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f357e03b0 0x557f35c6f410 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 >> 172.21.15.153:0/3998034248 conn(0x557f357fd3c0 msgr2=0x557f35bafc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 shutdown_connections 2024-09-17T03:15:55.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 1 -- 172.21.15.153:0/3998034248 wait complete. 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.260+0000 7fb10622e740 20 client.5565 trim_cache size 0 max 16384 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5433, 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:15:55.265 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.6557065169999996, 2024-09-17T03:15:55.266 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 34, 2024-09-17T03:15:55.266 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 58, 2024-09-17T03:15:55.266 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:15:55.266 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.691921493000001 2024-09-17T03:15:55.266 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 msgr2=0x7fb0d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 0x7fb0d407b0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8032000 tx=0x7fb0e8001190 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 msgr2=0x7fb0f80b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000e590 tx=0x7fb0e000ea50 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 shutdown_connections 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0d4078bc0 0x7fb0d407b0d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb0f809d350 0x7fb0f80b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0f809cf40 0x7fb0f80b5280 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 --2- 172.21.15.153:0/3919088302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0dc003ac0 0x7fb0f8146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 >> 172.21.15.153:0/3919088302 conn(0x7fb0f80d0070 msgr2=0x7fb0f815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 shutdown_connections 2024-09-17T03:15:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.261+0000 7fb0ff000640 1 -- 172.21.15.153:0/3919088302 wait complete. 2024-09-17T03:15:55.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:15:55.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 -- 172.21.15.153:0/3689079731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 msgr2=0x7fd9c015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 --2- 172.21.15.153:0/3689079731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c015bb40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009830 tx=0x7fd9b802a510 comp rx=0 tx=0).stop 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 -- 172.21.15.153:0/3689079731 shutdown_connections 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 --2- 172.21.15.153:0/3689079731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c015bb40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 --2- 172.21.15.153:0/3689079731 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 0x7fd9c006f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 -- 172.21.15.153:0/3689079731 >> 172.21.15.153:0/3689079731 conn(0x7fd9c00b19c0 msgr2=0x7fd9c00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 -- 172.21.15.153:0/3689079731 shutdown_connections 2024-09-17T03:15:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.509+0000 7fd9bf200640 1 -- 172.21.15.153:0/3689079731 wait complete. 2024-09-17T03:15:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.511+0000 7fd9bf200640 1 Processor -- start 2024-09-17T03:15:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.512+0000 7fd9bf200640 1 -- start start 2024-09-17T03:15:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 0x7fd9c01ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9c00cbe90 0x7fd9c00c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c015c410 con 0x7fd9c006f690 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c015c290 con 0x7fd9c00cbe90 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bf200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c015c590 con 0x7fd9c00ae5a0 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bde00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50200/0 (socket says 172.21.15.153:50200) 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9bde00640 1 -- 172.21.15.153:0/2907311833 learned_addr learned my addr 172.21.15.153:0/2907311833 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9b5400640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 0x7fd9c01ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.513+0000 7fd9be800640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9c00cbe90 0x7fd9c00c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 -- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 msgr2=0x7fd9c01ef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 0x7fd9c01ef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 -- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9c00cbe90 msgr2=0x7fd9c00c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9c00cbe90 0x7fd9c00c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 -- 172.21.15.153:0/2907311833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c00b4760 con 0x7fd9c006f690 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bde00640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c3a0 tx=0x7fd9b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0011790 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9b0017070 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0011cc0 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.514+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c00b4a40 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.515+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c009adf0 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.516+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c015bb40 con 0x7fd9c006f690 2024-09-17T03:15:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.517+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9b001c460 con 0x7fd9c006f690 2024-09-17T03:15:55.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.518+0000 7fd9b6a00640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 0x7fd99c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:55.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.518+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fd9b009ab80 con 0x7fd9c006f690 2024-09-17T03:15:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.518+0000 7fd9b5400640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 0x7fd99c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.519+0000 7fd9b5400640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 0x7fd99c07b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b0460 tx=0x7fd9a80095e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:55.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.522+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9b0062740 con 0x7fd9c006f690 2024-09-17T03:15:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.749+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9c00afc40 con 0x7fd9c006f690 2024-09-17T03:15:55.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.750+0000 7fd9b6a00640 1 -- 172.21.15.153:0/2907311833 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fd9b0067170 con 0x7fd9c006f690 2024-09-17T03:15:55.749 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 msgr2=0x7fd99c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 0x7fd99c07b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b0460 tx=0x7fd9a80095e0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 msgr2=0x7fd9c00b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c3a0 tx=0x7fd9b000c860 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 shutdown_connections 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd99c078bc0 0x7fd99c07b0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9c00cbe90 0x7fd9c00c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd9c00ae5a0 0x7fd9c01ef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 --2- 172.21.15.153:0/2907311833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9c006f690 0x7fd9c00b3e80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 >> 172.21.15.153:0/2907311833 conn(0x7fd9c00b19c0 msgr2=0x7fd9c00b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:55.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 shutdown_connections 2024-09-17T03:15:55.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:55.752+0000 7fd9bf200640 1 -- 172.21.15.153:0/2907311833 wait complete. 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:55.773 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:15:55.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:15:55.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:15:55.774 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:15:55.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:55.774 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-17T03:15:55.809 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:15:55.809 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:15:55.809 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-17T03:15:55.810 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42563sec preferred_lft 42563sec 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::48ca:57ff:fe1c:b853/64 scope link 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 32:bd:f5:93:c5:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::30bd:f5ff:fe93:c568/64 scope link 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.811 INFO:teuthology.orchestra.run.smithi153.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:15:55.812 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 96:f0:31:4d:ee:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:15:55.812 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::94f0:31ff:fe4d:ee13/64 scope link 2024-09-17T03:15:55.812 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:15:55.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:55.813 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:15:55.906 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-17T03:15:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:55.909 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-17T03:15:55.945 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-17T03:15:55.946 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:15:55.946 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:15:55.946 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:15:55.946 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:15:55.946 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:15:55.946 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-17T03:15:55.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:15:55.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:15:55.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:15:55.947 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-17T03:15:56.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:15:56.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:56.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:56.144 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:15:56.178 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:15:56.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:15:56.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:56.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-17T03:15:56.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:15:56.276 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:56.310 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:15:56.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:15:56.311 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:56.385 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:15:56.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:56.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:15:56.579 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:15:56.580 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:15:56.580 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:15:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:15:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:15:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:15:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:15:56.600 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:15:56.630 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:15:56.630 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790" 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.153:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2024-09-17T03:15:56.631 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5a48c3a5-c841-4727-8f9d-e71702e4a9bd" will pass to kernel 2024-09-17T03:15:56.632 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:15:56.632 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:15:56.633 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:15:56.633 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:15:56.633 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:15:56.636 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:15:56.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:56.636 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:56.693 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:15:56.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:15:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:56.789 INFO:teuthology.orchestra.run.smithi153.stdout:client5195 2024-09-17T03:15:56.789 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:15:56.789 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:56.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:15:56.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:15:56.964 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T03:15:56.964 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T03:15:56.965 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T03:15:56.966 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T03:15:56.967 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T03:15:56.968 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T03:15:56.969 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:15:56.970 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-17T03:15:56.971 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:56.972 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:56.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:15:56.974 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:15:56.975 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:15:56.976 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:15:56.976 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:15:56.976 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-17T03:15:56.976 INFO:teuthology.orchestra.run.smithi153.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.977 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:15:56.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T03:15:56.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T03:15:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T03:15:56.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.982 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T03:15:56.983 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:15:56.984 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T03:15:56.985 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:15:56.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T03:15:56.987 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-09-17T03:15:56.988 INFO:teuthology.orchestra.run.smithi164.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-09-17T03:15:57.002 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:15:57.002 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:15:57.003 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:15:57.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:57.003 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:15:57.003 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:15:57.003 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:15:57.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:57.004 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:15:57.004 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:15:57.004 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:15:57.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:57.004 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:15:57.004 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:15:57.004 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:15:57.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:15:57.026 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:15:57.026 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:15:57.027 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:15:57.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:15:57.028 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:15:57.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:15:57.033 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:15:57.033 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:15:57.071 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:15:57.071 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:57.073 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:15:57.073 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:57.078 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:15:57.079 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:57.081 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:15:57.081 DEBUG:teuthology.parallel:result is None 2024-09-17T03:15:57.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:57.265 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2024-09-17T03:15:57.266 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:15:57.267 INFO:tasks.ceph.mds.d.smithi164.stderr:2024-09-17T03:15:57.267+0000 7fbc5bc00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T03:15:57.276 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2024-09-17T03:15:57.276 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2024-09-17T03:15:57.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 -- 172.21.15.153:0/2142369736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34156e90 msgr2=0x7fec340703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:57.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 --2- 172.21.15.153:0/2142369736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34156e90 0x7fec340703b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec28009830 tx=0x7fec2802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 -- 172.21.15.153:0/2142369736 shutdown_connections 2024-09-17T03:15:57.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 --2- 172.21.15.153:0/2142369736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec340d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 --2- 172.21.15.153:0/2142369736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec34156e90 0x7fec340703b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 -- 172.21.15.153:0/2142369736 >> 172.21.15.153:0/2142369736 conn(0x7fec340b34b0 msgr2=0x7fec340b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:57.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 -- 172.21.15.153:0/2142369736 shutdown_connections 2024-09-17T03:15:57.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.314+0000 7fec3b800640 1 -- 172.21.15.153:0/2142369736 wait complete. 2024-09-17T03:15:57.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.316+0000 7fec3b800640 1 Processor -- start 2024-09-17T03:15:57.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.316+0000 7fec3b800640 1 -- start start 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 0x7fec341e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec3415f3c0 0x7fec341e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec340cd3a0 con 0x7fec3415f3c0 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fec340cd220 con 0x7fec340d0aa0 2024-09-17T03:15:57.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec3b800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fec340cd520 con 0x7fec340cc450 2024-09-17T03:15:57.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec39800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec3415f3c0 0x7fec341e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:57.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec38e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:57.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec38e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.153:50510/0 (socket says 172.21.15.153:50510) 2024-09-17T03:15:57.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec38e00640 1 -- 172.21.15.153:0/161308363 learned_addr learned my addr 172.21.15.153:0/161308363 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:57.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.318+0000 7fec33e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 0x7fec341e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 -- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 msgr2=0x7fec341e93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 0x7fec341e93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 -- 172.21.15.153:0/161308363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec3415f3c0 msgr2=0x7fec341e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec3415f3c0 0x7fec341e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 -- 172.21.15.153:0/161308363 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec340c6360 con 0x7fec340cc450 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec33e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 0x7fec341e93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:15:57.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec38e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec28009950 tx=0x7fec28003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28005c90 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec28005020 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28005450 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec340c6660 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.319+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec340b2240 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.320+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec34156e90 con 0x7fec340cc450 2024-09-17T03:15:57.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.322+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec280317c0 con 0x7fec340cc450 2024-09-17T03:15:57.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.322+0000 7fec30c00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 0x7fec1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:57.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.323+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 6101+0+0 (secure 0 0 0) 0x7fec280bbe10 con 0x7fec340cc450 2024-09-17T03:15:57.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.323+0000 7fec33e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 0x7fec1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:57.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.324+0000 7fec33e00640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 0x7fec1407b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec341f8be0 tx=0x7fec20005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:57.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.328+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec280bf030 con 0x7fec340cc450 2024-09-17T03:15:57.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.548+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec3406d560 con 0x7fec340cc450 2024-09-17T03:15:57.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.550+0000 7fec30c00640 1 -- 172.21.15.153:0/161308363 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5235 (secure 0 0 0) 0x7fec2803f030 con 0x7fec340cc450 2024-09-17T03:15:57.548 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:57.548 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"btime":"2024-09-17T03:15:51:637193+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/3522404014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":3522404014},{"type":"v1","addr":"172.21.15.164:6836","nonce":3522404014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/2004529324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":2004529324},{"type":"v1","addr":"172.21.15.164:6837","nonce":2004529324}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4173553541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4173553541},{"type":"v1","addr":"172.21.15.153:6835","nonce":4173553541}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:15:51.118681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1746730417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1746730417},{"type":"v1","addr":"172.21.15.153:6834","nonce":1746730417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5433,"qdb_cluster":[5433]},"id":3}]} 2024-09-17T03:15:57.548 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 34 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.551+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 msgr2=0x7fec1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.551+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 0x7fec1407b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec341f8be0 tx=0x7fec20005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.551+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 msgr2=0x7fec34099890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.551+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec28009950 tx=0x7fec28003c10 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 shutdown_connections 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fec14078bc0 0x7fec1407b0d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec3415f3c0 0x7fec341e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec340d0aa0 0x7fec341e93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 --2- 172.21.15.153:0/161308363 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec340cc450 0x7fec34099890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:57.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 >> 172.21.15.153:0/161308363 conn(0x7fec340b34b0 msgr2=0x7fec34074680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:57.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 shutdown_connections 2024-09-17T03:15:57.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:57.552+0000 7fec3b800640 1 -- 172.21.15.153:0/161308363 wait complete. 2024-09-17T03:15:57.667 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-09-17T03:15:57.668+0000 7f842e800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:15:57.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:15:48.101975+0000', 'modified': '2024-09-17T03:15:51.118681+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6834/1746730417', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1746730417}, {'type': 'v1', 'addr': '172.21.15.153:6834', 'nonce': 1746730417}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5433, 'qdb_cluster': [5433]} 2024-09-17T03:15:57.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:15:57.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.201+0000 7f39d3800640 1 -- 172.21.15.153:0/2770458188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc06ed40 msgr2=0x7f39cc15c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.201+0000 7f39d3800640 1 --2- 172.21.15.153:0/2770458188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc06ed40 0x7f39cc15c8b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009830 tx=0x7f39bc02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.202+0000 7f39d3800640 1 -- 172.21.15.153:0/2770458188 shutdown_connections 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.202+0000 7f39d3800640 1 --2- 172.21.15.153:0/2770458188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc06ed40 0x7f39cc15c8b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.202+0000 7f39d3800640 1 -- 172.21.15.153:0/2770458188 >> 172.21.15.153:0/2770458188 conn(0x7f39cc0b1c50 msgr2=0x7f39cc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.202+0000 7f39d3800640 1 -- 172.21.15.153:0/2770458188 shutdown_connections 2024-09-17T03:15:58.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.202+0000 7f39d3800640 1 -- 172.21.15.153:0/2770458188 wait complete. 2024-09-17T03:15:58.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.204+0000 7f39d3800640 1 Processor -- start 2024-09-17T03:15:58.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.204+0000 7f39d3800640 1 -- start start 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39cc06ed40 0x7f39cc0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0706e0 0x7f39cc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc074a10 con 0x7f39cc09cc00 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0cab50 con 0x7f39cc0706e0 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.205+0000 7f39d3800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc074b90 con 0x7f39cc06ed40 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50252/0 (socket says 172.21.15.153:50252) 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 -- 172.21.15.153:0/3135217453 learned_addr learned my addr 172.21.15.153:0/3135217453 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:58.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39c3e00640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0706e0 0x7f39cc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39cc06ed40 0x7f39cc0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 -- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39cc06ed40 msgr2=0x7f39cc0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39cc06ed40 0x7f39cc0c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 -- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0706e0 msgr2=0x7f39cc0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0706e0 0x7f39cc0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 -- 172.21.15.153:0/3135217453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc1f6fd0 con 0x7f39cc09cc00 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.206+0000 7f39d1800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f39c400cb70 tx=0x7f39c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.207+0000 7f39c9600640 1 -- 172.21.15.153:0/3135217453 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c400ad40 con 0x7f39cc09cc00 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.207+0000 7f39c9600640 1 -- 172.21.15.153:0/3135217453 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39c4017070 con 0x7f39cc09cc00 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.207+0000 7f39c9600640 1 -- 172.21.15.153:0/3135217453 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4012660 con 0x7f39cc09cc00 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.207+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc1f72b0 con 0x7f39cc09cc00 2024-09-17T03:15:58.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.207+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc1f7870 con 0x7f39cc09cc00 2024-09-17T03:15:58.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.209+0000 7f39c9600640 1 -- 172.21.15.153:0/3135217453 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39c4012800 con 0x7f39cc09cc00 2024-09-17T03:15:58.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.210+0000 7f39c9600640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.210+0000 7f39c9600640 1 -- 172.21.15.153:0/3135217453 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f39c409b250 con 0x7f39cc09cc00 2024-09-17T03:15:58.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.210+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.211+0000 7f39da8b4740 1 Processor -- start 2024-09-17T03:15:58.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.211+0000 7f39da8b4740 1 -- start start 2024-09-17T03:15:58.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.211+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 0x7f39a807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39bc034000 tx=0x7f39bc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec3b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55938eb95430 con 0x55938e8423b0 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55938eb855d0 con 0x55938e86b270 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55938eb74a00 con 0x55938e84a590 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.212+0000 7f39c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39d0e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec3b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39d1800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50268/0 (socket says 172.21.15.153:50268) 2024-09-17T03:15:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 -- 172.21.15.153:0/2063352878 learned_addr learned my addr 172.21.15.153:0/2063352878 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 -- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 msgr2=0x55938ec0bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec0bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 -- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 msgr2=0x55938ec3b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec3b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 -- 172.21.15.153:0/2063352878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55938eb3d520 con 0x55938e8423b0 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c3e00640 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f39b4001780 tx=0x7f39b4001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0143c15c0b64f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.213+0000 7f39c1600640 1 -- 172.21.15.153:0/2063352878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40052e0 con 0x55938e8423b0 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39c1600640 1 -- 172.21.15.153:0/2063352878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4018070 con 0x55938e8423b0 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39c1600640 1 -- 172.21.15.153:0/2063352878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b400f9b0 con 0x55938e8423b0 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 -- 172.21.15.153:0/2063352878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 msgr2=0x55938ec3beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f39b4001780 tx=0x7f39b4001c40 comp rx=0 tx=0).stop 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 -- 172.21.15.153:0/2063352878 shutdown_connections 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec0bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec3beb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 --2- 172.21.15.153:0/2063352878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec3b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.214+0000 7f39da8b4740 1 -- 172.21.15.153:0/2063352878 >> 172.21.15.153:0/2063352878 conn(0x55938e85f3c0 msgr2=0x55938ec11970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.215+0000 7f39da8b4740 1 -- 172.21.15.153:0/2063352878 shutdown_connections 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.215+0000 7f39da8b4740 1 -- 172.21.15.153:0/2063352878 wait complete. 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.216+0000 7f39da8b4740 1 -- start start 2024-09-17T03:15:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.216+0000 7f39da8b4740 1 Processor -- start 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec37c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec38140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55938eb1b330 con 0x55938e8423b0 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55938eb78810 con 0x55938e86b270 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.217+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55938e8e5620 con 0x55938e84a590 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39da8b4740 10 client.0 _ll_register_callbacks cb 0x55938eb20420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:58.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50282/0 (socket says 172.21.15.153:50282) 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 -- 172.21.15.153:0/1443170100 learned_addr learned my addr 172.21.15.153:0/1443170100 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39c3e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec37c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d1800640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec38140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 -- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 msgr2=0x55938ec37c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec37c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 -- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 msgr2=0x55938ec38140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec38140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 -- 172.21.15.153:0/1443170100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55938e8d6850 con 0x55938e8423b0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39c3e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec37c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39d0e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005eb0 tx=0x7f39bc02a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b493c1fbcfb156 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.218+0000 7f39ba000640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:15:58.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc047790 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f39bc052c90 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b4018070 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f39bc052e90 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 10 client.5613 fetch_fsmap learned FSMap version 37 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55938e94d6b0 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4018070 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f39bc043040 con 0x55938e8423b0 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 10 client.5613 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 10 client.5613 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 20 client.5613 populate_metadata read hostname 'smithi153' 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938e829e40 0x55938ec4fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 4 client.5613 mds_command: new command op to 5216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.219+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 --> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55938eb87520 con 0x55938e829e40 2024-09-17T03:15:58.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.220+0000 7f39c3e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938e829e40 0x55938ec4fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.220+0000 7f39ba000640 10 client.5613 ms_handle_connect on v2:172.21.15.153:6833/4265279562 2024-09-17T03:15:58.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.220+0000 7f39c3e00640 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938e829e40 0x55938ec4fd60 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=52ad534517b7bc59 server_cookie=9d49854d9679df6e in_seq=0 out_seq=0 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.221+0000 7f39ba000640 1 -- 172.21.15.153:0/1443170100 <== mds.? v2:172.21.15.153:6833/4265279562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24313 (crc 0 0 0) 0x55938eb87520 con 0x55938e829e40 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.221+0000 7f39ba000640 10 client.5613 handle_command_reply: tid=0 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.221+0000 7f39da8b4740 1 client.5613 shutdown 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 msgr2=0x55938ec2d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005eb0 tx=0x7f39bc02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 shutdown_connections 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938e829e40 0x55938ec4fd60 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e86b270 0x55938ec38140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e84a590 0x55938ec37c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39ba000640 0 client.5613 ms_handle_reset on v2:172.21.15.153:6833/4265279562 2024-09-17T03:15:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 --2- 172.21.15.153:0/1443170100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e8423b0 0x55938ec2d0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 >> 172.21.15.153:0/1443170100 conn(0x55938e85f3c0 msgr2=0x55938ec4cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 shutdown_connections 2024-09-17T03:15:58.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 1 -- 172.21.15.153:0/1443170100 wait complete. 2024-09-17T03:15:58.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.222+0000 7f39da8b4740 20 client.5613 trim_cache size 0 max 16384 2024-09-17T03:15:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.241+0000 7f39da8b4740 1 Processor -- start 2024-09-17T03:15:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.241+0000 7f39da8b4740 1 -- start start 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.242+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e8423b0 0x55938ec117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.242+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e86b270 0x55938ec30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39da8b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc1ff660 con 0x55938e84a590 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc09b300 con 0x55938e8423b0 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc1ff110 con 0x55938e86b270 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50296/0 (socket says 172.21.15.153:50296) 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 -- 172.21.15.153:0/3944251233 learned_addr learned my addr 172.21.15.153:0/3944251233 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 -- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e86b270 msgr2=0x55938ec30940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e86b270 0x55938ec30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 -- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e8423b0 msgr2=0x55938ec117f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e8423b0 0x55938ec117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 -- 172.21.15.153:0/3944251233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55938e81c930 con 0x55938e84a590 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.243+0000 7f39c3e00640 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f39b400fa40 tx=0x7f39b4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba17dd1a810d453c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39c0c00640 1 -- 172.21.15.153:0/3944251233 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b400fda0 con 0x55938e84a590 2024-09-17T03:15:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39c0c00640 1 -- 172.21.15.153:0/3944251233 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4018040 con 0x55938e84a590 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39c0c00640 1 -- 172.21.15.153:0/3944251233 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4003830 con 0x55938e84a590 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39da8b4740 1 -- 172.21.15.153:0/3944251233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 msgr2=0x55938ec11d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f39b400fa40 tx=0x7f39b4007df0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39da8b4740 1 -- 172.21.15.153:0/3944251233 shutdown_connections 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e86b270 0x55938ec30940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.244+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e84a590 0x55938ec11d30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.245+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3944251233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e8423b0 0x55938ec117f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.245+0000 7f39da8b4740 1 -- 172.21.15.153:0/3944251233 >> 172.21.15.153:0/3944251233 conn(0x55938e85f3c0 msgr2=0x55938ec0d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.245+0000 7f39da8b4740 1 -- 172.21.15.153:0/3944251233 shutdown_connections 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.245+0000 7f39da8b4740 1 -- 172.21.15.153:0/3944251233 wait complete. 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.246+0000 7f39da8b4740 1 -- start start 2024-09-17T03:15:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.246+0000 7f39da8b4740 1 Processor -- start 2024-09-17T03:15:58.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e8423b0 0x55938ec67df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e84a590 0x55938ec31210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55938ec68df0 con 0x55938e86b270 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55938ec4d8f0 con 0x55938e84a590 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x55938ec693b0 con 0x55938e8423b0 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39da8b4740 10 client.0 _ll_register_callbacks cb 0x7f39bc03ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.247+0000 7f39d1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50306/0 (socket says 172.21.15.153:50306) 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 -- 172.21.15.153:0/3773740454 learned_addr learned my addr 172.21.15.153:0/3773740454 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e8423b0 0x55938ec67df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39c3e00640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e84a590 0x55938ec31210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 -- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e8423b0 msgr2=0x55938ec67df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e8423b0 0x55938ec67df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 -- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e84a590 msgr2=0x55938ec31210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e84a590 0x55938ec31210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 -- 172.21.15.153:0/3773740454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55938ec120e0 con 0x55938e86b270 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39d1800640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f39c4099530 tx=0x7f39c4062770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aac1dc7892a8d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39ba000640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c407d060 con 0x55938e86b270 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f39c4062140 con 0x55938e86b270 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.248+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b4018040 con 0x55938e86b270 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f39c4083050 con 0x55938e86b270 2024-09-17T03:15:58.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 10 client.5619 fetch_fsmap learned FSMap version 37 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x55938ec2fcd0 con 0x55938e86b270 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4018040 con 0x55938e86b270 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7f39c407e020 con 0x55938e86b270 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 10 client.5619 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 10 client.5619 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 20 client.5619 populate_metadata read hostname 'smithi153' 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938ec5a180 0x55938ec55d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 4 client.5619 mds_command: new command op to 5216 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 --> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] -- command(tid 0: {"prefix": "status"}) -- 0x55938eb82fd0 con 0x55938ec5a180 2024-09-17T03:15:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.249+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938ec5a180 0x55938ec55d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39d0e00640 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938ec5a180 0x55938ec55d90 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=3411c805a67f5acc server_cookie=4d001b92d0258713 in_seq=0 out_seq=0 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39ba000640 10 client.5619 ms_handle_connect on v2:172.21.15.153:6833/4265279562 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39ba000640 1 -- 172.21.15.153:0/3773740454 <== mds.? v2:172.21.15.153:6833/4265279562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55938eb82fd0 con 0x55938ec5a180 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39ba000640 10 client.5619 handle_command_reply: tid=0 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 client.5619 shutdown 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 msgr2=0x55938ecd9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f39c4099530 tx=0x7f39c4062770 comp rx=0 tx=0).stop 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 shutdown_connections 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:6833/4265279562,v1:172.21.15.153:6835/4265279562] conn(0x55938ec5a180 0x55938ec55d90 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55938e86b270 0x55938ecd9a00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55938e84a590 0x55938ec31210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 --2- 172.21.15.153:0/3773740454 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55938e8423b0 0x55938ec67df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39ba000640 0 client.5619 ms_handle_reset on v2:172.21.15.153:6833/4265279562 2024-09-17T03:15:58.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 >> 172.21.15.153:0/3773740454 conn(0x55938e85f3c0 msgr2=0x55938ec117f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.250+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 shutdown_connections 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39da8b4740 1 -- 172.21.15.153:0/3773740454 wait complete. 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39da8b4740 20 client.5619 trim_cache size 0 max 16384 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:15:58.259 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": -1, 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5216, 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:standby", 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:standby", 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 36, 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 0, 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 0, 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 0.97015142899999995 2024-09-17T03:15:58.260 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 msgr2=0x7f39a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 0x7f39a807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39bc034000 tx=0x7f39bc004730 comp rx=0 tx=0).stop 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 msgr2=0x7f39cc06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f39c400cb70 tx=0x7f39c400a430 comp rx=0 tx=0).stop 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 shutdown_connections 2024-09-17T03:15:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f39a8078b90 0x7f39a807b0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39cc09cc00 0x7f39cc06d900 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f39cc0706e0 0x7f39cc0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 --2- 172.21.15.153:0/3135217453 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f39cc06ed40 0x7f39cc0c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 >> 172.21.15.153:0/3135217453 conn(0x7f39cc0b1c50 msgr2=0x7f39cc0cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 shutdown_connections 2024-09-17T03:15:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:58.251+0000 7f39d3800640 1 -- 172.21.15.153:0/3135217453 wait complete. 2024-09-17T03:15:59.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:59.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 -- 172.21.15.153:0/2748124231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 msgr2=0x7f484c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 --2- 172.21.15.153:0/2748124231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c0cc450 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4844005fd0 tx=0x7f484402ab40 comp rx=0 tx=0).stop 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 -- 172.21.15.153:0/2748124231 shutdown_connections 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 --2- 172.21.15.153:0/2748124231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c0cc450 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 -- 172.21.15.153:0/2748124231 >> 172.21.15.153:0/2748124231 conn(0x7f484c0b34b0 msgr2=0x7f484c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 -- 172.21.15.153:0/2748124231 shutdown_connections 2024-09-17T03:15:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.499+0000 7f4851800640 1 -- 172.21.15.153:0/2748124231 wait complete. 2024-09-17T03:15:59.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.502+0000 7f4851800640 1 Processor -- start 2024-09-17T03:15:59.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.502+0000 7f4851800640 1 -- start start 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f484c15b3f0 0x7f484c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f484c073f90 0x7f484c0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f484c06e220 con 0x7f484c0703b0 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f484c06e0a0 con 0x7f484c073f90 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f4851800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f484c06e3a0 con 0x7f484c15b3f0 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.503+0000 7f484aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50318/0 (socket says 172.21.15.153:50318) 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 -- 172.21.15.153:0/2342982338 learned_addr learned my addr 172.21.15.153:0/2342982338 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 -- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f484c15b3f0 msgr2=0x7f484c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f484c15b3f0 0x7f484c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 -- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f484c073f90 msgr2=0x7f484c0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f484c073f90 0x7f484c0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 -- 172.21.15.153:0/2342982338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c158380 con 0x7f484c0703b0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f484aa00640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f483c00c3a0 tx=0x7f483c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.504+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c017070 con 0x7f484c0703b0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.505+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483c0035f0 con 0x7f484c0703b0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.505+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c003a40 con 0x7f484c0703b0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.505+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484c1f57b0 con 0x7f484c0703b0 2024-09-17T03:15:59.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.505+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484c1580a0 con 0x7f484c0703b0 2024-09-17T03:15:59.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.506+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484c156e90 con 0x7f484c0703b0 2024-09-17T03:15:59.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.507+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f483c01a070 con 0x7f484c0703b0 2024-09-17T03:15:59.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.508+0000 7f4842a00640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:59.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.509+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f483c09a320 con 0x7f484c0703b0 2024-09-17T03:15:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.509+0000 7f484a000640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.510+0000 7f484a000640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f484c0ca8d0 tx=0x7f4838007970 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:59.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.513+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f484c158380 con 0x7f484c0703b0 2024-09-17T03:15:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.733+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f484c06da60 con 0x7f484c0703b0 2024-09-17T03:15:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.733+0000 7f4842a00640 1 -- 172.21.15.153:0/2342982338 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5223 (secure 0 0 0) 0x7f484c0707c0 con 0x7f484c0703b0 2024-09-17T03:15:59.734 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:15:59.734 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":39,"btime":"2024-09-17T03:15:59:684521+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:15:58.694048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-17T03:15:59.734 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 39 2024-09-17T03:15:59.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 msgr2=0x7f482c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:59.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f484c0ca8d0 tx=0x7f4838007970 comp rx=0 tx=0).stop 2024-09-17T03:15:59.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 msgr2=0x7f484c1f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f483c00c3a0 tx=0x7f483c00c860 comp rx=0 tx=0).stop 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 shutdown_connections 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f484c073f90 0x7f484c0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f484c15b3f0 0x7f484c0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 --2- 172.21.15.153:0/2342982338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f484c0703b0 0x7f484c1f5270 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 >> 172.21.15.153:0/2342982338 conn(0x7f484c0b34b0 msgr2=0x7f484c072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 shutdown_connections 2024-09-17T03:15:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:15:59.736+0000 7f4851800640 1 -- 172.21.15.153:0/2342982338 wait complete. 2024-09-17T03:16:00.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:15:48.101975+0000', 'modified': '2024-09-17T03:15:58.694048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5583': {'gid': 5583, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.164:6836/1937223305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1937223305}, {'type': 'v1', 'addr': '172.21.15.164:6836', 'nonce': 1937223305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:16:00.163 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5583:up:rejoin 2024-09-17T03:16:01.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 -- 172.21.15.153:0/4028577292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 msgr2=0x7f8180160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 --2- 172.21.15.153:0/4028577292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f8180160880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8168009900 tx=0x7f816802a690 comp rx=0 tx=0).stop 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 -- 172.21.15.153:0/4028577292 shutdown_connections 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 --2- 172.21.15.153:0/4028577292 >> v2:172.21.15.164:3300/0 conn(0x7f81800ce740 0x7f81800ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 --2- 172.21.15.153:0/4028577292 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f8180160880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 -- 172.21.15.153:0/4028577292 >> 172.21.15.153:0/4028577292 conn(0x7f81800cfed0 msgr2=0x7f81800d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 -- 172.21.15.153:0/4028577292 shutdown_connections 2024-09-17T03:16:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.396+0000 7f8185e00640 1 -- 172.21.15.153:0/4028577292 wait complete. 2024-09-17T03:16:01.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.399+0000 7f8185e00640 1 Processor -- start 2024-09-17T03:16:01.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.399+0000 7f8185e00640 1 -- start start 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f81800b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8180145800 0x7f8180074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81800cf420 con 0x7f81800ce740 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f81800cf2a0 con 0x7f8180145800 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.400+0000 7f8185e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f81800cf5a0 con 0x7f81801451a0 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50328/0 (socket says 172.21.15.153:50328) 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 -- 172.21.15.153:0/3001314364 learned_addr learned my addr 172.21.15.153:0/3001314364 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8177e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f81800b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8185400640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8180145800 0x7f8180074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 -- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 msgr2=0x7f81800b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f81800b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 -- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8180145800 msgr2=0x7f8180074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8180145800 0x7f8180074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 -- 172.21.15.153:0/3001314364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81800b4100 con 0x7f81800ce740 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.401+0000 7f8184a00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f817000c430 tx=0x7f817000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.402+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170017070 con 0x7f81800ce740 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.402+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81801f8ea0 con 0x7f81800ce740 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.402+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81700053e0 con 0x7f81800ce740 2024-09-17T03:16:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.402+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170003850 con 0x7f81800ce740 2024-09-17T03:16:01.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.402+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81801f9460 con 0x7f81800ce740 2024-09-17T03:16:01.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.403+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81800ceb50 con 0x7f81800ce740 2024-09-17T03:16:01.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.404+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f817001a070 con 0x7f81800ce740 2024-09-17T03:16:01.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.405+0000 7f817d600640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 0x7f815c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:01.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.405+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f817009a220 con 0x7f81800ce740 2024-09-17T03:16:01.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.405+0000 7f8177e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 0x7f815c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:01.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.406+0000 7f8177e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 0x7f815c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8168033000 tx=0x7f8168004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:01.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.410+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8170061d10 con 0x7f81800ce740 2024-09-17T03:16:01.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.626+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f818015c4e0 con 0x7f81800ce740 2024-09-17T03:16:01.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.627+0000 7f817d600640 1 -- 172.21.15.153:0/3001314364 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5229 (secure 0 0 0) 0x7f8170066740 con 0x7f81800ce740 2024-09-17T03:16:01.627 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:01.627 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"btime":"2024-09-17T03:16:00:689975+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:15:59.694077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-17T03:16:01.627 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2024-09-17T03:16:01.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 msgr2=0x7f815c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 0x7f815c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8168033000 tx=0x7f8168004730 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 msgr2=0x7f81800b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f817000c430 tx=0x7f817000c830 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 shutdown_connections 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f815c078b90 0x7f815c07b0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8180145800 0x7f8180074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f81801451a0 0x7f81800b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 --2- 172.21.15.153:0/3001314364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81800ce740 0x7f81800b3bc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 >> 172.21.15.153:0/3001314364 conn(0x7f81800cfed0 msgr2=0x7f81801416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 shutdown_connections 2024-09-17T03:16:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:01.630+0000 7f8185e00640 1 -- 172.21.15.153:0/3001314364 wait complete. 2024-09-17T03:16:02.056 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:15:48.101975+0000', 'modified': '2024-09-17T03:15:59.694077+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5583': {'gid': 5583, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.164:6836/1937223305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1937223305}, {'type': 'v1', 'addr': '172.21.15.164:6836', 'nonce': 1937223305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:16:02.056 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5583:up:clientreplay 2024-09-17T03:16:02.683 INFO:tasks.ceph.mds.b.smithi164.stderr:2024-09-17T03:16:02.685+0000 7f869d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:16:03.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 -- 172.21.15.153:0/3848083296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180cc450 msgr2=0x7f081806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 --2- 172.21.15.153:0/3848083296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180cc450 0x7f081806d780 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0810005fd0 tx=0x7f081002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 -- 172.21.15.153:0/3848083296 shutdown_connections 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 --2- 172.21.15.153:0/3848083296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180cc450 0x7f081806d780 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 --2- 172.21.15.153:0/3848083296 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f08180d0c70 0x7f08180703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 -- 172.21.15.153:0/3848083296 >> 172.21.15.153:0/3848083296 conn(0x7f08180b34b0 msgr2=0x7f08180b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 -- 172.21.15.153:0/3848083296 shutdown_connections 2024-09-17T03:16:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.290+0000 7f081d600640 1 -- 172.21.15.153:0/3848083296 wait complete. 2024-09-17T03:16:03.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.293+0000 7f081d600640 1 Processor -- start 2024-09-17T03:16:03.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.293+0000 7f081d600640 1 -- start start 2024-09-17T03:16:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08180cc450 0x7f08180cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 0x7f0818155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f081806e050 con 0x7f08180c6850 2024-09-17T03:16:03.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f081806ded0 con 0x7f08180cc450 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.294+0000 7f081d600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f081806e1d0 con 0x7f0818155bd0 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50352/0 (socket says 172.21.15.153:50352) 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 -- 172.21.15.153:0/2997343589 learned_addr learned my addr 172.21.15.153:0/2997343589 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f0816a00640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08180cc450 0x7f08180cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f0817400640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 0x7f0818155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 -- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 msgr2=0x7f0818155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 0x7f0818155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 -- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08180cc450 msgr2=0x7f08180cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08180cc450 0x7f08180cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 -- 172.21.15.153:0/2997343589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08181f5fd0 con 0x7f08180c6850 2024-09-17T03:16:03.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f0817400640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 0x7f0818155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.295+0000 7f080e000640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f080000d740 tx=0x7f080000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.296+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800017070 con 0x7f08180c6850 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.296+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0800009d20 con 0x7f08180c6850 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.296+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000106c0 con 0x7f08180c6850 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.296+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08180b22b0 con 0x7f08180c6850 2024-09-17T03:16:03.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.296+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08180b2870 con 0x7f08180c6850 2024-09-17T03:16:03.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.297+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0818156e90 con 0x7f08180c6850 2024-09-17T03:16:03.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.298+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f080001a070 con 0x7f08180c6850 2024-09-17T03:16:03.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.299+0000 7f080f400640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 0x7f07f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.299+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f080009aff0 con 0x7f08180c6850 2024-09-17T03:16:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.300+0000 7f0816a00640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 0x7f07f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.301+0000 7f0816a00640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 0x7f07f407b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.304+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0800062c50 con 0x7f08180c6850 2024-09-17T03:16:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.521+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f081806d560 con 0x7f08180c6850 2024-09-17T03:16:03.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.521+0000 7f080f400640 1 -- 172.21.15.153:0/2997343589 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f0800067680 con 0x7f08180c6850 2024-09-17T03:16:03.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:03.521 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:03.521 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:03.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 msgr2=0x7f07f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 0x7f07f407b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0808007fd0 tx=0x7f0808001370 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 msgr2=0x7f0818155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f080000d740 tx=0x7f080000dc00 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 shutdown_connections 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f07f4078b90 0x7f07f407b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0818155bd0 0x7f0818155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08180c6850 0x7f0818155690 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 --2- 172.21.15.153:0/2997343589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08180cc450 0x7f08180cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 >> 172.21.15.153:0/2997343589 conn(0x7f08180b34b0 msgr2=0x7f0818072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 shutdown_connections 2024-09-17T03:16:03.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:03.524+0000 7f081d600640 1 -- 172.21.15.153:0/2997343589 wait complete. 2024-09-17T03:16:03.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:15:48.101975+0000', 'modified': '2024-09-17T03:16:01.700614+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5583}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5583': {'gid': 5583, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.164:6836/1937223305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1937223305}, {'type': 'v1', 'addr': '172.21.15.164:6836', 'nonce': 1937223305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5583, 'qdb_cluster': [5583]} 2024-09-17T03:16:03.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:16:03.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 -- 172.21.15.153:0/4102716699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006e450 msgr2=0x7f8cf00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/4102716699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006e450 0x7f8cf00ca7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8005fd0 tx=0x7f8ce802aa10 comp rx=0 tx=0).stop 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 -- 172.21.15.153:0/4102716699 shutdown_connections 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/4102716699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006e450 0x7f8cf00ca7b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/4102716699 >> v2:172.21.15.164:3300/0 conn(0x7f8cf006ed40 0x7f8cf015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.170+0000 7f8cf4c00640 1 -- 172.21.15.153:0/4102716699 >> 172.21.15.153:0/4102716699 conn(0x7f8cf00b1c50 msgr2=0x7f8cf00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.171+0000 7f8cf4c00640 1 -- 172.21.15.153:0/4102716699 shutdown_connections 2024-09-17T03:16:04.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.171+0000 7f8cf4c00640 1 -- 172.21.15.153:0/4102716699 wait complete. 2024-09-17T03:16:04.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.173+0000 7f8cf4c00640 1 Processor -- start 2024-09-17T03:16:04.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.173+0000 7f8cf4c00640 1 -- start start 2024-09-17T03:16:04.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006ed40 0x7f8cf01f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8cf00706e0 0x7f8cf01f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf0074710 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf0074590 con 0x7f8cf00706e0 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.174+0000 7f8cf4c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf0074890 con 0x7f8cf006ed40 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53194/0 (socket says 172.21.15.153:53194) 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 -- 172.21.15.153:0/2529726243 learned_addr learned my addr 172.21.15.153:0/2529726243 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cede00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006ed40 0x7f8cf01f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8ce5400640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8cf00706e0 0x7f8cf01f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 -- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006ed40 msgr2=0x7f8cf01f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006ed40 0x7f8cf01f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 -- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8cf00706e0 msgr2=0x7f8cf01f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8cf00706e0 0x7f8cf01f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.175+0000 7f8cee800640 1 -- 172.21.15.153:0/2529726243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf00b5c90 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8cee800640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009d90 tx=0x7f8ce8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8ce6a00640 1 -- 172.21.15.153:0/2529726243 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8033050 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8ce6a00640 1 -- 172.21.15.153:0/2529726243 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce8004450 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf00c8070 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8ce6a00640 1 -- 172.21.15.153:0/2529726243 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8004860 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.176+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf01f95a0 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.178+0000 7f8ce6a00640 1 -- 172.21.15.153:0/2529726243 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ce8036070 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.179+0000 7f8ce6a00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.179+0000 7f8ce6a00640 1 -- 172.21.15.153:0/2529726243 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f8ce80bc200 con 0x7f8cf01f8cd0 2024-09-17T03:16:04.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.180+0000 7f8cede00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.180+0000 7f8cfbc5d740 1 Processor -- start 2024-09-17T03:16:04.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.180+0000 7f8cfbc5d740 1 -- start start 2024-09-17T03:16:04.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.180+0000 7f8cede00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009b30 tx=0x7f8ce0005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f60eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f30f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ce4eba430 con 0x560ce4b90270 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560ce4eaa5d0 con 0x560ce4b673b0 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.181+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560ce4e99a00 con 0x560ce4b6f590 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53198/0 (socket says 172.21.15.153:53198) 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 -- 172.21.15.153:0/135311703 learned_addr learned my addr 172.21.15.153:0/135311703 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cee800640 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f30f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8ce5400640 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f60eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 -- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 msgr2=0x560ce4f30f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f30f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 -- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 msgr2=0x560ce4f60eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f60eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 -- 172.21.15.153:0/135311703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ce4e62520 con 0x560ce4b90270 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.182+0000 7f8cede00640 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0011e60 tx=0x7f8ce0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db96122b44cc653 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.183+0000 7f8cde600640 1 -- 172.21.15.153:0/135311703 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ebf0 con 0x560ce4b90270 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.183+0000 7f8cde600640 1 -- 172.21.15.153:0/135311703 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce0004020 con 0x560ce4b90270 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.183+0000 7f8cde600640 1 -- 172.21.15.153:0/135311703 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00043d0 con 0x560ce4b90270 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/135311703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 msgr2=0x560ce4f60970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0011e60 tx=0x7f8ce0014000 comp rx=0 tx=0).stop 2024-09-17T03:16:04.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/135311703 shutdown_connections 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f30f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f60eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/135311703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f60970 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/135311703 >> 172.21.15.153:0/135311703 conn(0x560ce4b843c0 msgr2=0x560ce4f36970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/135311703 shutdown_connections 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.184+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/135311703 wait complete. 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.185+0000 7f8cfbc5d740 1 -- start start 2024-09-17T03:16:04.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.185+0000 7f8cfbc5d740 1 Processor -- start 2024-09-17T03:16:04.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.186+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f75590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 0x560ce4f8e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ce4e40330 con 0x560ce4b6f590 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560ce4e9d810 con 0x560ce4b673b0 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560ce4c0a620 con 0x560ce4b90270 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cfbc5d740 10 client.0 _ll_register_callbacks cb 0x560ce4e45420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53204/0 (socket says 172.21.15.153:53204) 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 -- 172.21.15.153:0/3292113369 learned_addr learned my addr 172.21.15.153:0/3292113369 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cede00640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f75590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cee800640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 0x560ce4f8e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 -- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 msgr2=0x560ce4f8e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 0x560ce4f8e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 -- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 msgr2=0x560ce4f75590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f75590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 -- 172.21.15.153:0/3292113369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ce4bfb850 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cee800640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 0x560ce4f8e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8ce5400640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80122f0 tx=0x7f8cd80127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff48b1b67df79a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.187+0000 7f8cd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8019020 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f8cd80052e0 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce0004020 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8cd8023050 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 10 client.5649 fetch_fsmap learned FSMap version 41 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x560ce4c726b0 con 0x560ce4b6f590 2024-09-17T03:16:04.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce0004020 con 0x560ce4b6f590 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f8cd8026020 con 0x560ce4b6f590 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 10 client.5649 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 10 client.5649 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 20 client.5649 populate_metadata read hostname 'smithi153' 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4b4ee40 0x560ce4f8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 4 client.5649 mds_command: new command op to 5583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.188+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 --> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ce4eac520 con 0x560ce4b4ee40 2024-09-17T03:16:04.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.189+0000 7f8cede00640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4b4ee40 0x560ce4f8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.190+0000 7f8cede00640 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4b4ee40 0x560ce4f8b050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f26ab9dab1c7f8 server_cookie=ebb7cd99315a7d26 in_seq=0 out_seq=0 2024-09-17T03:16:04.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.190+0000 7f8cd2a00640 10 client.5649 ms_handle_connect on v2:172.21.15.164:6834/1937223305 2024-09-17T03:16:04.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cd2a00640 1 -- 172.21.15.153:0/3292113369 <== mds.0 v2:172.21.15.164:6834/1937223305 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ce4eac520 con 0x560ce4b4ee40 2024-09-17T03:16:04.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cd2a00640 10 client.5649 handle_command_reply: tid=0 2024-09-17T03:16:04.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 client.5649 shutdown 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 msgr2=0x560ce4f74020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80122f0 tx=0x7f8cd80127b0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 shutdown_connections 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4b4ee40 0x560ce4f8b050 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b90270 0x560ce4f8e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b6f590 0x560ce4f74020 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/3292113369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4f75590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cd2a00640 0 client.5649 ms_handle_reset on v2:172.21.15.164:6834/1937223305 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 >> 172.21.15.153:0/3292113369 conn(0x560ce4b843c0 msgr2=0x560ce4f60970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 shutdown_connections 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/3292113369 wait complete. 2024-09-17T03:16:04.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.191+0000 7f8cfbc5d740 20 client.5649 trim_cache size 0 max 16384 2024-09-17T03:16:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.210+0000 7f8cfbc5d740 1 Processor -- start 2024-09-17T03:16:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.210+0000 7f8cfbc5d740 1 -- start start 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f9ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 0x560ce4f9f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf0201a20 con 0x560ce4b673b0 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf0200db0 con 0x560ce4b90270 2024-09-17T03:16:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf02013d0 con 0x560ce4b6f590 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.211+0000 7f8cede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53214/0 (socket says 172.21.15.153:53214) 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 -- 172.21.15.153:0/1184855819 learned_addr learned my addr 172.21.15.153:0/1184855819 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 -- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 msgr2=0x560ce4f9ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f9ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cee800640 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 0x560ce4f9f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 -- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 msgr2=0x560ce4f9f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 0x560ce4f9f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 -- 172.21.15.153:0/1184855819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ce4f7eaa0 con 0x560ce4b673b0 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cee800640 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 0x560ce4f9f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cede00640 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e780 tx=0x7f8ce00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44e32d7c2a252a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cddc00640 1 -- 172.21.15.153:0/1184855819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0004030 con 0x560ce4b673b0 2024-09-17T03:16:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cddc00640 1 -- 172.21.15.153:0/1184855819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce002c040 con 0x560ce4b673b0 2024-09-17T03:16:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.212+0000 7f8cddc00640 1 -- 172.21.15.153:0/1184855819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0004430 con 0x560ce4b673b0 2024-09-17T03:16:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/1184855819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 msgr2=0x560ce4f57df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e780 tx=0x7f8ce00046c0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/1184855819 shutdown_connections 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b90270 0x560ce4f9f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4f9ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/1184855819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b673b0 0x560ce4f57df0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/1184855819 >> 172.21.15.153:0/1184855819 conn(0x560ce4b843c0 msgr2=0x560ce4f34e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/1184855819 shutdown_connections 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.213+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/1184855819 wait complete. 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.214+0000 7f8cfbc5d740 1 -- start start 2024-09-17T03:16:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.214+0000 7f8cfbc5d740 1 Processor -- start 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4ff5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4ffe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ce4f59d80 con 0x560ce4b90270 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560ce4f5d870 con 0x560ce4b673b0 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560ce4f59200 con 0x560ce4b6f590 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cfbc5d740 10 client.0 _ll_register_callbacks cb 0x7f8cd8001b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cee800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cee800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53226/0 (socket says 172.21.15.153:53226) 2024-09-17T03:16:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cee800640 1 -- 172.21.15.153:0/626379035 learned_addr learned my addr 172.21.15.153:0/626379035 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8ce5400640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4ffe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.216+0000 7f8cede00640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4ff5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 -- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 msgr2=0x560ce4ffe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4ffe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 -- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 msgr2=0x560ce4ff5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4ff5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 -- 172.21.15.153:0/626379035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ce4f34e00 con 0x560ce4b90270 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8ce5400640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4ffe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cede00640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4ff5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cee800640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009a10 tx=0x7f8ce80842c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a996a8611ddb672 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cd2a00640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce806f030 con 0x560ce4b90270 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f8ce8004b40 con 0x560ce4b90270 2024-09-17T03:16:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce002c040 con 0x560ce4b90270 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8ce80834e0 con 0x560ce4b90270 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cfbc5d740 10 client.5655 fetch_fsmap learned FSMap version 41 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x560ce4f89f60 con 0x560ce4b90270 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.217+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce002c040 con 0x560ce4b90270 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f8ce8040070 con 0x560ce4b90270 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 10 client.5655 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 10 client.5655 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 20 client.5655 populate_metadata read hostname 'smithi153' 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4f841b0 0x560ce4f9d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 4 client.5655 mds_command: new command op to 5583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 --> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] -- command(tid 0: {"prefix": "status"}) -- 0x560ce4ea7fd0 con 0x560ce4f841b0 2024-09-17T03:16:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.218+0000 7f8cede00640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4f841b0 0x560ce4f9d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cede00640 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4f841b0 0x560ce4f9d8e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06919eb06a82532 server_cookie=1d52c29a5381afe4 in_seq=0 out_seq=0 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cd2a00640 10 client.5655 ms_handle_connect on v2:172.21.15.164:6834/1937223305 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cd2a00640 1 -- 172.21.15.153:0/626379035 <== mds.0 v2:172.21.15.164:6834/1937223305 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560ce4ea7fd0 con 0x560ce4f841b0 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cd2a00640 10 client.5655 handle_command_reply: tid=0 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 client.5655 shutdown 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 msgr2=0x560ce4f5bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009a10 tx=0x7f8ce80842c0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 shutdown_connections 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ce4b90270 0x560ce4f5bcd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:6834/1937223305,v1:172.21.15.164:6836/1937223305] conn(0x560ce4f841b0 0x560ce4f9d8e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560ce4b6f590 0x560ce4ffe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 --2- 172.21.15.153:0/626379035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560ce4b673b0 0x560ce4ff5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 >> 172.21.15.153:0/626379035 conn(0x560ce4b843c0 msgr2=0x560ce4f7f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cd2a00640 0 client.5655 ms_handle_reset on v2:172.21.15.164:6834/1937223305 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 shutdown_connections 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.219+0000 7f8cfbc5d740 1 -- 172.21.15.153:0/626379035 wait complete. 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cfbc5d740 20 client.5655 trim_cache size 0 max 16384 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "5a48c3a5-c841-4727-8f9d-e71702e4a9bd", 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5583, 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.5366488399999998, 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 41, 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 62, 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 62, 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 6.9490378780000004 2024-09-17T03:16:04.223 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 msgr2=0x7f8ccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009b30 tx=0x7f8ce0005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 msgr2=0x7f8cf00cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009d90 tx=0x7f8ce8003f10 comp rx=0 tx=0).stop 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 shutdown_connections 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cf01f8cd0 0x7f8cf00cea20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8cf00706e0 0x7f8cf01f8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 --2- 172.21.15.153:0/2529726243 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8cf006ed40 0x7f8cf01f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 >> 172.21.15.153:0/2529726243 conn(0x7f8cf00b1c50 msgr2=0x7f8cf00afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 shutdown_connections 2024-09-17T03:16:04.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.220+0000 7f8cf4c00640 1 -- 172.21.15.153:0/2529726243 wait complete. 2024-09-17T03:16:04.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.465+0000 7f213f200640 1 -- 172.21.15.153:0/265109212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380cdf50 msgr2=0x7f21380ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.465+0000 7f213f200640 1 --2- 172.21.15.153:0/265109212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380cdf50 0x7f21380ce6e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2128005fd0 tx=0x7f212802a830 comp rx=0 tx=0).stop 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 -- 172.21.15.153:0/265109212 shutdown_connections 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 --2- 172.21.15.153:0/265109212 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380d0670 0x7f21380d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 --2- 172.21.15.153:0/265109212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380cdf50 0x7f21380ce6e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 -- 172.21.15.153:0/265109212 >> 172.21.15.153:0/265109212 conn(0x7f21380b34b0 msgr2=0x7f21380b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 -- 172.21.15.153:0/265109212 shutdown_connections 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.466+0000 7f213f200640 1 -- 172.21.15.153:0/265109212 wait complete. 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.468+0000 7f213f200640 1 Processor -- start 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.468+0000 7f213f200640 1 -- start start 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 0x7f213809d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 0x7f21380ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21380cbcd0 con 0x7f213806cd30 2024-09-17T03:16:04.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f21380cbb50 con 0x7f21380d0670 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.469+0000 7f213f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f21380cbe50 con 0x7f21380cdf50 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53234/0 (socket says 172.21.15.153:53234) 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 -- 172.21.15.153:0/2231065274 learned_addr learned my addr 172.21.15.153:0/2231065274 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f213d200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 0x7f21380ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f212f400640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 0x7f213809d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 -- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 msgr2=0x7f213809d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 0x7f213809d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 -- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 msgr2=0x7f21380ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 0x7f21380ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f2137e00640 1 -- 172.21.15.153:0/2231065274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21380c6010 con 0x7f213806cd30 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f212f400640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 0x7f213809d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.470+0000 7f213d200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 0x7f21380ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f2137e00640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2128034040 tx=0x7f2128032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128041020 con 0x7f213806cd30 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2128032e50 con 0x7f213806cd30 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128036040 con 0x7f213806cd30 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21380c62f0 con 0x7f213806cd30 2024-09-17T03:16:04.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.471+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21380c68b0 con 0x7f213806cd30 2024-09-17T03:16:04.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.472+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213806dd80 con 0x7f213806cd30 2024-09-17T03:16:04.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.473+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2128044020 con 0x7f213806cd30 2024-09-17T03:16:04.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.475+0000 7f2134c00640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 0x7f211407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:04.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.475+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f21280bbfb0 con 0x7f213806cd30 2024-09-17T03:16:04.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.476+0000 7f212f400640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 0x7f211407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:04.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.476+0000 7f212f400640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 0x7f211407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2138159fa0 tx=0x7f2120005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:04.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.479+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f212804b030 con 0x7f213806cd30 2024-09-17T03:16:04.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.703+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21380cd730 con 0x7f213806cd30 2024-09-17T03:16:04.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.703+0000 7f2134c00640 1 -- 172.21.15.153:0/2231065274 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f2128084280 con 0x7f213806cd30 2024-09-17T03:16:04.703 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:04.703 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:04.703 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 msgr2=0x7f211407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 0x7f211407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2138159fa0 tx=0x7f2120005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 msgr2=0x7f21380b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2128034040 tx=0x7f2128032c60 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 shutdown_connections 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2114078b90 0x7f211407b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21380d0670 0x7f21380ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f21380cdf50 0x7f213809d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 --2- 172.21.15.153:0/2231065274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f213806cd30 0x7f21380b2610 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 >> 172.21.15.153:0/2231065274 conn(0x7f21380b34b0 msgr2=0x7f21380ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 shutdown_connections 2024-09-17T03:16:04.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:04.706+0000 7f213f200640 1 -- 172.21.15.153:0/2231065274 wait complete. 2024-09-17T03:16:04.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:04.980 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":41,"msgr_send_messages":35,"msgr_recv_bytes":129243,"msgr_send_bytes":38234,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014547645,"msgr_running_send_time":0.002184471,"msgr_running_recv_time":0.011107443,"msgr_running_fast_dispatch_time":0.000484092,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.009979726,"avgtime":0.000293521},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":120240,"msgr_send_encrypted_bytes":6176},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":9,"msgr_recv_bytes":1386,"msgr_send_bytes":95317,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006115070,"msgr_running_send_time":0.000832766,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":8,"sum":0.007362124,"avgtime":0.000920265},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93856},"AsyncMessenger::Worker-2":{"msgr_recv_messages":35,"msgr_send_messages":33,"msgr_recv_bytes":22672,"msgr_send_bytes":10671,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011594446,"msgr_running_send_time":0.003274952,"msgr_running_recv_time":0.007229680,"msgr_running_fast_dispatch_time":0.001029478,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.016748993,"avgtime":0.000523406},"msgr_handle_ack_lat":{"avgcount":3,"sum":0.000002336,"avgtime":0.000000778},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.004862307,"avgtime":0.000101298}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":2,"reply":0,"reply_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":7,"inodes_bottom":3,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":1,"traverse_hit":1,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":0},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":2,"evex":0,"evtrm":0,"ev":5,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196434,"rdpos":4195244,"jlat":{"avgcount":2,"sum":0.005678980,"avgtime":0.002839490},"replayed":3},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":1,"cap-":0,"rss":107088,"heap":347955200},"mds_server":{"dispatch_client_request":1,"dispatch_server_request":0,"handle_client_request":2,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":0,"average_load":0,"avg_session_uptime":704,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239267,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52800,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":1469,"op_resend":0,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.104998172,"avgtime":0.002282568},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":92},"op":46,"op_r":36,"op_w":10,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":2,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":77,"get_sum":143434,"get_or_fail_fail":0,"get_or_fail_success":77,"take":0,"take_sum":0,"put":77,"put_sum":143434,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":2404,"put":46,"put_sum":2404,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":2,"get_sum":931,"get_or_fail_fail":0,"get_or_fail_success":2,"take":0,"take_sum":0,"put":2,"put_sum":931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:04.983 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 129243, "msgr_recv_encrypted_bytes": 120240, "msgr_recv_messages": 41, "msgr_running_fast_dispatch_time": 0.000484092, "msgr_running_recv_time": 0.011107443, "msgr_running_send_time": 0.002184471, "msgr_running_total_time": 0.014547645, "msgr_send_bytes": 38234, "msgr_send_encrypted_bytes": 6176, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000293521, "sum": 0.009979726 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.000832766, "msgr_running_total_time": 0.00611507, "msgr_send_bytes": 95317, "msgr_send_encrypted_bytes": 93856, "msgr_send_messages": 9, "msgr_send_messages_queue_lat": { "avgcount": 8, "avgtime": 0.000920265, "sum": 0.007362124 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 3, "avgtime": 7.78e-07, "sum": 2.336e-06 }, "msgr_recv_bytes": 22672, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 35, "msgr_running_fast_dispatch_time": 0.001029478, "msgr_running_recv_time": 0.00722968, "msgr_running_send_time": 0.003274952, "msgr_running_total_time": 0.011594446, "msgr_send_bytes": 10671, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000523406, "sum": 0.016748993 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 0.000101298, "sum": 0.004862307 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 3, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 7, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 0, "q": 0, "reply": 0, "reply_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "request": 2, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 1, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 1, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 5, "evadd": 2, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 2, "avgtime": 0.00283949, "sum": 0.00567898 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4196434 }, "mds_mem": { "cap": 1, "cap+": 1, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 347955200, "ino": 13, "ino+": 13, "ino-": 0, "rss": 107088 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 1, "dispatch_server_request": 0, "handle_client_request": 2, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 0, "avg_session_uptime": 704, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 0 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239267, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52800, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.002282568, "sum": 0.104998172 }, "op_pg": 0, "op_r": 36, "op_reply": 46, "op_resend": 0, "op_rmw": 0, "op_send": 46, "op_send_bytes": 1469, "op_w": 10, "oplen_avg": { "avgcount": 46, "sum": 92 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 77, "get_or_fail_fail": 0, "get_or_fail_success": 77, "get_started": 0, "get_sum": 143434, "max": 104857600, "put": 77, "put_sum": 143434, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 2404, "take": 46, "take_sum": 2404, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 2, "get_or_fail_fail": 0, "get_or_fail_success": 2, "get_started": 0, "get_sum": 931, "max": 3758096384, "put": 2, "put_sum": 931, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:04.983 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_0:0 2024-09-17T03:16:04.983 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:04.984 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> stdin-killer -- python3 -c ' 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> import fcntl 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> import os 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> import time 2024-09-17T03:16:05.021 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> with open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", '"'"'w'"'"') as f: 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> f.write("content") 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> while True: 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> print("open_background: keeping file open", file=sys.stderr) 2024-09-17T03:16:05.022 DEBUG:teuthology.orchestra.run.smithi153:> try: 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> if os.read(0, 4096) == b"": 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> break 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> except BlockingIOError: 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> pass 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> time.sleep(2) 2024-09-17T03:16:05.023 DEBUG:teuthology.orchestra.run.smithi153:> ' 2024-09-17T03:16:05.065 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-09-17T03:16:05.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:05.101 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/omap_counter_test_file': No such file or directory 2024-09-17T03:16:05.168 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:16:06.101 DEBUG:teuthology.orchestra.run.smithi153:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-09-17T03:16:06.142 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-17T03:16:06.142 INFO:tasks.cephfs.mount:File omap_counter_test_file became visible with size 7 from 0 after 1s 2024-09-17T03:16:06.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 -- 172.21.15.153:0/2546210891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00708e0 msgr2=0x7f82e00cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 --2- 172.21.15.153:0/2546210891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00708e0 0x7f82e00cf3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82d402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 -- 172.21.15.153:0/2546210891 shutdown_connections 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 --2- 172.21.15.153:0/2546210891 >> v2:172.21.15.164:3300/0 conn(0x7f82e006f5e0 0x7f82e01655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 --2- 172.21.15.153:0/2546210891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00708e0 0x7f82e00cf3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.409+0000 7f82e8400640 1 -- 172.21.15.153:0/2546210891 >> 172.21.15.153:0/2546210891 conn(0x7f82e00b34b0 msgr2=0x7f82e00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:06.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.410+0000 7f82e8400640 1 -- 172.21.15.153:0/2546210891 shutdown_connections 2024-09-17T03:16:06.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.410+0000 7f82e8400640 1 -- 172.21.15.153:0/2546210891 wait complete. 2024-09-17T03:16:06.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.412+0000 7f82e8400640 1 Processor -- start 2024-09-17T03:16:06.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.412+0000 7f82e8400640 1 -- start start 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 0x7f82e0156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00cf930 0x7f82e00c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82e0070300 con 0x7f82e00708e0 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f82e0070180 con 0x7f82e006f5e0 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e8400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f82e0072e70 con 0x7f82e00cf930 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:06.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53242/0 (socket says 172.21.15.153:53242) 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 -- 172.21.15.153:0/867028620 learned_addr learned my addr 172.21.15.153:0/867028620 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5a00640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 0x7f82e0156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e6400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00cf930 0x7f82e00c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 -- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00cf930 msgr2=0x7f82e00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00cf930 0x7f82e00c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 -- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 msgr2=0x7f82e0156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 0x7f82e0156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5000640 1 -- 172.21.15.153:0/867028620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e015a110 con 0x7f82e00708e0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.414+0000 7f82e5a00640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 0x7f82e0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82e5000640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c3f0 tx=0x7f82cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc017070 con 0x7f82e00708e0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82cc0053c0 con 0x7f82e00708e0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e00b1dc0 con 0x7f82e00708e0 2024-09-17T03:16:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc003850 con 0x7f82e00708e0 2024-09-17T03:16:06.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.415+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e00b2340 con 0x7f82e00708e0 2024-09-17T03:16:06.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.416+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e0069140 con 0x7f82e00708e0 2024-09-17T03:16:06.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.417+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82cc01a070 con 0x7f82e00708e0 2024-09-17T03:16:06.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.418+0000 7f82dd600640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 0x7f82c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:06.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.418+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f82cc09a3e0 con 0x7f82e00708e0 2024-09-17T03:16:06.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.419+0000 7f82e5a00640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 0x7f82c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:06.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.419+0000 7f82e5a00640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 0x7f82c007b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f82d4033000 tx=0x7f82d4004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:06.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.423+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82e0069140 con 0x7f82e00708e0 2024-09-17T03:16:06.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.639+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82e015acc0 con 0x7f82e00708e0 2024-09-17T03:16:06.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.640+0000 7f82dd600640 1 -- 172.21.15.153:0/867028620 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f82e00b1dc0 con 0x7f82e00708e0 2024-09-17T03:16:06.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:06.639 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:06.639 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:06.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 msgr2=0x7f82c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:06.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 0x7f82c007b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f82d4033000 tx=0x7f82d4004730 comp rx=0 tx=0).stop 2024-09-17T03:16:06.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 msgr2=0x7f82e00c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:06.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c3f0 tx=0x7f82cc00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 shutdown_connections 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f82c0078bc0 0x7f82c007b0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f82e00cf930 0x7f82e00c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82e00708e0 0x7f82e00c9360 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 --2- 172.21.15.153:0/867028620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82e006f5e0 0x7f82e0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 >> 172.21.15.153:0/867028620 conn(0x7f82e00b34b0 msgr2=0x7f82e00ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 shutdown_connections 2024-09-17T03:16:06.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:06.642+0000 7f82e8400640 1 -- 172.21.15.153:0/867028620 wait complete. 2024-09-17T03:16:06.665 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:06.914 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":44,"msgr_send_messages":38,"msgr_recv_bytes":130115,"msgr_send_bytes":41339,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014974621,"msgr_running_send_time":0.002401342,"msgr_running_recv_time":0.011185306,"msgr_running_fast_dispatch_time":0.000580676,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.010144876,"avgtime":0.000274185},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":120240,"msgr_send_encrypted_bytes":6176},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":9,"msgr_recv_bytes":1386,"msgr_send_bytes":95317,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006115070,"msgr_running_send_time":0.000832766,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":8,"sum":0.007362124,"avgtime":0.000920265},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93856},"AsyncMessenger::Worker-2":{"msgr_recv_messages":40,"msgr_send_messages":36,"msgr_recv_bytes":24549,"msgr_send_bytes":12720,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012253717,"msgr_running_send_time":0.003505576,"msgr_running_recv_time":0.007538229,"msgr_running_fast_dispatch_time":0.001166872,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.016850965,"avgtime":0.000481456},"msgr_handle_ack_lat":{"avgcount":4,"sum":0.000003219,"avgtime":0.000000804},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":52,"sum":0.005599242,"avgtime":0.000107677}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198223,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.007612715,"avgtime":0.002537571},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":107728,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":704,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239267,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52800,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3794,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.113998017,"avgtime":0.002235255},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":85,"get_sum":145511,"get_or_fail_fail":0,"get_or_fail_success":85,"take":0,"take_sum":0,"put":85,"put_sum":145511,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4729,"put":51,"put_sum":4729,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2720,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2720,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:06.916 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 130115, "msgr_recv_encrypted_bytes": 120240, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.000580676, "msgr_running_recv_time": 0.011185306, "msgr_running_send_time": 0.002401342, "msgr_running_total_time": 0.014974621, "msgr_send_bytes": 41339, "msgr_send_encrypted_bytes": 6176, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000274185, "sum": 0.010144876 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.000832766, "msgr_running_total_time": 0.00611507, "msgr_send_bytes": 95317, "msgr_send_encrypted_bytes": 93856, "msgr_send_messages": 9, "msgr_send_messages_queue_lat": { "avgcount": 8, "avgtime": 0.000920265, "sum": 0.007362124 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 4, "avgtime": 8.04e-07, "sum": 3.219e-06 }, "msgr_recv_bytes": 24549, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.001166872, "msgr_running_recv_time": 0.007538229, "msgr_running_send_time": 0.003505576, "msgr_running_total_time": 0.012253717, "msgr_send_bytes": 12720, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000481456, "sum": 0.016850965 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 52, "avgtime": 0.000107677, "sum": 0.005599242 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002537571, "sum": 0.007612715 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198223 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 107728 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 704, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239267, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52800, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.002235255, "sum": 0.113998017 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3794, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 85, "get_or_fail_fail": 0, "get_or_fail_success": 85, "get_started": 0, "get_sum": 145511, "max": 104857600, "put": 85, "put_sum": 145511, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4729, "take": 51, "take_sum": 4729, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2720, "max": 3758096384, "put": 3, "put_sum": 2720, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:06.916 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:16:06.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 -- 172.21.15.153:0/3259213781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b006d940 msgr2=0x7f06b00d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 --2- 172.21.15.153:0/3259213781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b006d940 0x7f06b00d0560 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f06b00afb70 tx=0x7f069c02a580 comp rx=0 tx=0).stop 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 -- 172.21.15.153:0/3259213781 shutdown_connections 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 --2- 172.21.15.153:0/3259213781 >> v2:172.21.15.164:3300/0 conn(0x7f06b00d0aa0 0x7f06b00cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 --2- 172.21.15.153:0/3259213781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b006d940 0x7f06b00d0560 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 --2- 172.21.15.153:0/3259213781 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00cc9f0 0x7f06b006d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.139+0000 7f06b7800640 1 -- 172.21.15.153:0/3259213781 >> 172.21.15.153:0/3259213781 conn(0x7f06b00b34b0 msgr2=0x7f06b00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.140+0000 7f06b7800640 1 -- 172.21.15.153:0/3259213781 shutdown_connections 2024-09-17T03:16:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.140+0000 7f06b7800640 1 -- 172.21.15.153:0/3259213781 wait complete. 2024-09-17T03:16:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.142+0000 7f06b7800640 1 Processor -- start 2024-09-17T03:16:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.142+0000 7f06b7800640 1 -- start start 2024-09-17T03:16:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 0x7f06b01f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00d0aa0 0x7f06b01f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00cc030 con 0x7f06b00cc9f0 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00cbeb0 con 0x7f06b006d940 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.143+0000 7f06b7800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f06b00cc1b0 con 0x7f06b00d0aa0 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53270/0 (socket says 172.21.15.153:53270) 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 -- 172.21.15.153:0/3829691178 learned_addr learned my addr 172.21.15.153:0/3829691178 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06b4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 0x7f06b01f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06b5800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00d0aa0 0x7f06b01f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 -- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00d0aa0 msgr2=0x7f06b01f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00d0aa0 0x7f06b01f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 -- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 msgr2=0x7f06b01f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 0x7f06b01f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 -- 172.21.15.153:0/3829691178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b01f9c60 con 0x7f06b00cc9f0 2024-09-17T03:16:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06b4e00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 0x7f06b01f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.144+0000 7f06afe00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f069c034040 tx=0x7f069c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.145+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c03e030 con 0x7f06b00cc9f0 2024-09-17T03:16:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.145+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f069c003ca0 con 0x7f06b00cc9f0 2024-09-17T03:16:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.145+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b01f9f40 con 0x7f06b00cc9f0 2024-09-17T03:16:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.145+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c035040 con 0x7f06b00cc9f0 2024-09-17T03:16:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.145+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b009d500 con 0x7f06b00cc9f0 2024-09-17T03:16:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.146+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b01f99d0 con 0x7f06b00cc9f0 2024-09-17T03:16:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.147+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f069c041030 con 0x7f06b00cc9f0 2024-09-17T03:16:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.148+0000 7f06acc00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 0x7f069007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.148+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f069c0bb5b0 con 0x7f06b00cc9f0 2024-09-17T03:16:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.149+0000 7f06b4e00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 0x7f069007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.149+0000 7f06b4e00640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 0x7f069007b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009ea0 tx=0x7f06a4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.153+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f069c083120 con 0x7f06b00cc9f0 2024-09-17T03:16:07.170 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:16:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.370+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06b01f6c50 con 0x7f06b00cc9f0 2024-09-17T03:16:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.370+0000 7f06acc00640 1 -- 172.21.15.153:0/3829691178 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f06b01f6c50 con 0x7f06b00cc9f0 2024-09-17T03:16:07.369 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:07.370 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.372+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 msgr2=0x7f069007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.372+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 0x7f069007b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009ea0 tx=0x7f06a4005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 msgr2=0x7f06b00b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f069c034040 tx=0x7f069c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 shutdown_connections 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f0690078bc0 0x7f069007b0d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f06b00d0aa0 0x7f06b01f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b00cc9f0 0x7f06b00b25d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 --2- 172.21.15.153:0/3829691178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06b006d940 0x7f06b01f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 >> 172.21.15.153:0/3829691178 conn(0x7f06b00b34b0 msgr2=0x7f06b015f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 shutdown_connections 2024-09-17T03:16:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07.373+0000 7f06b7800640 1 -- 172.21.15.153:0/3829691178 wait complete. 2024-09-17T03:16:07.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:07.641 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":44,"msgr_send_messages":38,"msgr_recv_bytes":130115,"msgr_send_bytes":41339,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.014974621,"msgr_running_send_time":0.002401342,"msgr_running_recv_time":0.011185306,"msgr_running_fast_dispatch_time":0.000580676,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.010144876,"avgtime":0.000274185},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":120240,"msgr_send_encrypted_bytes":6176},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":9,"msgr_recv_bytes":1386,"msgr_send_bytes":95317,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006115070,"msgr_running_send_time":0.000832766,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":8,"sum":0.007362124,"avgtime":0.000920265},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93856},"AsyncMessenger::Worker-2":{"msgr_recv_messages":40,"msgr_send_messages":36,"msgr_recv_bytes":24549,"msgr_send_bytes":12720,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012253717,"msgr_running_send_time":0.003505576,"msgr_running_recv_time":0.007538229,"msgr_running_fast_dispatch_time":0.001166872,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.016850965,"avgtime":0.000481456},"msgr_handle_ack_lat":{"avgcount":4,"sum":0.000003219,"avgtime":0.000000804},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":52,"sum":0.005599242,"avgtime":0.000107677}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198223,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.007612715,"avgtime":0.002537571},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":107728,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":709,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239923,"buffer_anon_items":76,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56376,"mds_co_items":248,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3794,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.113998017,"avgtime":0.002235255},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":85,"get_sum":145511,"get_or_fail_fail":0,"get_or_fail_success":85,"take":0,"take_sum":0,"put":85,"put_sum":145511,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4729,"put":51,"put_sum":4729,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2720,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2720,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:07.642 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 130115, "msgr_recv_encrypted_bytes": 120240, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.000580676, "msgr_running_recv_time": 0.011185306, "msgr_running_send_time": 0.002401342, "msgr_running_total_time": 0.014974621, "msgr_send_bytes": 41339, "msgr_send_encrypted_bytes": 6176, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000274185, "sum": 0.010144876 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.000832766, "msgr_running_total_time": 0.00611507, "msgr_send_bytes": 95317, "msgr_send_encrypted_bytes": 93856, "msgr_send_messages": 9, "msgr_send_messages_queue_lat": { "avgcount": 8, "avgtime": 0.000920265, "sum": 0.007362124 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 4, "avgtime": 8.04e-07, "sum": 3.219e-06 }, "msgr_recv_bytes": 24549, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.001166872, "msgr_running_recv_time": 0.007538229, "msgr_running_send_time": 0.003505576, "msgr_running_total_time": 0.012253717, "msgr_send_bytes": 12720, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000481456, "sum": 0.016850965 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 52, "avgtime": 0.000107677, "sum": 0.005599242 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002537571, "sum": 0.007612715 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198223 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 107728 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 709, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239923, "buffer_anon_items": 76, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56376, "mds_co_items": 248, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.002235255, "sum": 0.113998017 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3794, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 85, "get_or_fail_fail": 0, "get_or_fail_success": 85, "get_started": 0, "get_sum": 145511, "max": 104857600, "put": 85, "put_sum": 145511, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4729, "take": 51, "take_sum": 4729, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2720, "max": 3758096384, "put": 3, "put_sum": 2720, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:07.643 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_1:2 2024-09-17T03:16:07.643 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi153') 2024-09-17T03:16:07.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:07 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-17T03:16:09.172 INFO:teuthology.orchestra.run.smithi153.stderr:open_background: keeping file open 2024-09-17T03:16:09.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:16:09.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 -- 172.21.15.153:0/140034420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 msgr2=0x7f8e58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 --2- 172.21.15.153:0/140034420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e58004c10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009b50 tx=0x7f8e58005830 comp rx=0 tx=0).stop 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e73e00640 1 -- 172.21.15.153:0/140034420 reap_dead start 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 -- 172.21.15.153:0/140034420 shutdown_connections 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 -- 172.21.15.153:0/140034420 >> 172.21.15.153:0/140034420 conn(0x7f8e740b34b0 msgr2=0x7f8e740b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 -- 172.21.15.153:0/140034420 shutdown_connections 2024-09-17T03:16:09.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.460+0000 7f8e7a000640 1 -- 172.21.15.153:0/140034420 wait complete. 2024-09-17T03:16:09.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.463+0000 7f8e7a000640 1 Processor -- start 2024-09-17T03:16:09.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.463+0000 7f8e7a000640 1 -- start start 2024-09-17T03:16:09.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 0x7f8e741e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 0x7f8e740ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740703b0 con 0x7f8e58004800 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e740d0e80 con 0x7f8e740743e0 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e7a000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8e74070530 con 0x7f8e740b05a0 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e73400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e73400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53292/0 (socket says 172.21.15.153:53292) 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.464+0000 7f8e73400640 1 -- 172.21.15.153:0/3240257923 learned_addr learned my addr 172.21.15.153:0/3240257923 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73e00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 0x7f8e740ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e72a00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 0x7f8e741e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 -- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 msgr2=0x7f8e740ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:09.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 0x7f8e740ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 -- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 msgr2=0x7f8e741e78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 0x7f8e741e78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 -- 172.21.15.153:0/3240257923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e740ae060 con 0x7f8e58004800 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73e00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 0x7f8e740ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e72a00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 0x7f8e741e78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e73400640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006630 tx=0x7f8e640039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64015070 con 0x7f8e58004800 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.465+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e64011900 con 0x7f8e58004800 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.466+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011d50 con 0x7f8e58004800 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.466+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e740ce000 con 0x7f8e58004800 2024-09-17T03:16:09.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.466+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e740add30 con 0x7f8e58004800 2024-09-17T03:16:09.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.467+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e740ce1d0 con 0x7f8e58004800 2024-09-17T03:16:09.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.468+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e64018070 con 0x7f8e58004800 2024-09-17T03:16:09.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.469+0000 7f8e6b400640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 0x7f8e5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:09.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.469+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6187+0+0 (secure 0 0 0) 0x7f8e6409bdb0 con 0x7f8e58004800 2024-09-17T03:16:09.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.469+0000 7f8e72a00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 0x7f8e5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:09.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.470+0000 7f8e72a00640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 0x7f8e5407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e60035000 tx=0x7f8e6002d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.473+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e640a0070 con 0x7f8e58004800 2024-09-17T03:16:09.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.694+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e741e6ef0 con 0x7f8e58004800 2024-09-17T03:16:09.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.694+0000 7f8e6b400640 1 -- 172.21.15.153:0/3240257923 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f8e64064010 con 0x7f8e58004800 2024-09-17T03:16:09.694 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:09.694 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:09.694 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 msgr2=0x7f8e5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 0x7f8e5407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e60035000 tx=0x7f8e6002d040 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 msgr2=0x7f8e7409dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006630 tx=0x7f8e640039c0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 shutdown_connections 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f8e54078b90 0x7f8e5407b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e740b05a0 0x7f8e740ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e740743e0 0x7f8e741e78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 --2- 172.21.15.153:0/3240257923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e58004800 0x7f8e7409dc80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 >> 172.21.15.153:0/3240257923 conn(0x7f8e740b34b0 msgr2=0x7f8e74155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:09.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 shutdown_connections 2024-09-17T03:16:09.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:09.697+0000 7f8e7a000640 1 -- 172.21.15.153:0/3240257923 wait complete. 2024-09-17T03:16:09.720 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:09.973 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":45,"msgr_send_messages":39,"msgr_recv_bytes":130387,"msgr_send_bytes":41979,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.015166410,"msgr_running_send_time":0.002534533,"msgr_running_recv_time":0.011247868,"msgr_running_fast_dispatch_time":0.000580676,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.010232208,"avgtime":0.000269268},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":120512,"msgr_send_encrypted_bytes":6816},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":10,"msgr_recv_bytes":1386,"msgr_send_bytes":97157,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006187303,"msgr_running_send_time":0.000898207,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":9,"sum":0.007394600,"avgtime":0.000821622},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95696},"AsyncMessenger::Worker-2":{"msgr_recv_messages":43,"msgr_send_messages":36,"msgr_recv_bytes":25755,"msgr_send_bytes":12720,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012760651,"msgr_running_send_time":0.003617085,"msgr_running_recv_time":0.007719608,"msgr_running_fast_dispatch_time":0.001367908,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.016850965,"avgtime":0.000481456},"msgr_handle_ack_lat":{"avgcount":4,"sum":0.000003219,"avgtime":0.000000804},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":52,"sum":0.005599242,"avgtime":0.000107677}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198223,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.007612715,"avgtime":0.002537571},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":107984,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":709,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239923,"buffer_anon_items":76,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56376,"mds_co_items":248,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3794,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.113998017,"avgtime":0.002235255},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":89,"get_sum":146625,"get_or_fail_fail":0,"get_or_fail_success":89,"take":0,"take_sum":0,"put":89,"put_sum":146625,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4729,"put":51,"put_sum":4729,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2720,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2720,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:09.975 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 130387, "msgr_recv_encrypted_bytes": 120512, "msgr_recv_messages": 45, "msgr_running_fast_dispatch_time": 0.000580676, "msgr_running_recv_time": 0.011247868, "msgr_running_send_time": 0.002534533, "msgr_running_total_time": 0.01516641, "msgr_send_bytes": 41979, "msgr_send_encrypted_bytes": 6816, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000269268, "sum": 0.010232208 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.000898207, "msgr_running_total_time": 0.006187303, "msgr_send_bytes": 97157, "msgr_send_encrypted_bytes": 95696, "msgr_send_messages": 10, "msgr_send_messages_queue_lat": { "avgcount": 9, "avgtime": 0.000821622, "sum": 0.0073946 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 4, "avgtime": 8.04e-07, "sum": 3.219e-06 }, "msgr_recv_bytes": 25755, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 43, "msgr_running_fast_dispatch_time": 0.001367908, "msgr_running_recv_time": 0.007719608, "msgr_running_send_time": 0.003617085, "msgr_running_total_time": 0.012760651, "msgr_send_bytes": 12720, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000481456, "sum": 0.016850965 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 52, "avgtime": 0.000107677, "sum": 0.005599242 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002537571, "sum": 0.007612715 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198223 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 107984 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 709, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239923, "buffer_anon_items": 76, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56376, "mds_co_items": 248, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.002235255, "sum": 0.113998017 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3794, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 89, "get_or_fail_fail": 0, "get_or_fail_success": 89, "get_started": 0, "get_sum": 146625, "max": 104857600, "put": 89, "put_sum": 146625, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4729, "take": 51, "take_sum": 4729, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2720, "max": 3758096384, "put": 3, "put_sum": 2720, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:09.976 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-09-17T03:16:14.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:15.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbb6600640 1 -- 172.21.15.153:0/3849284186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 msgr2=0x7fcb94003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3849284186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcb94003e70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009b50 tx=0x7fcb94005830 comp rx=0 tx=0).stop 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbafe00640 1 -- 172.21.15.153:0/3849284186 reap_dead start 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbb6600640 1 -- 172.21.15.153:0/3849284186 shutdown_connections 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbb6600640 1 -- 172.21.15.153:0/3849284186 >> 172.21.15.153:0/3849284186 conn(0x7fcbb00b34b0 msgr2=0x7fcbb00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.210+0000 7fcbb6600640 1 -- 172.21.15.153:0/3849284186 shutdown_connections 2024-09-17T03:16:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.211+0000 7fcbb6600640 1 -- 172.21.15.153:0/3849284186 wait complete. 2024-09-17T03:16:15.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.213+0000 7fcbb6600640 1 Processor -- start 2024-09-17T03:16:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.213+0000 7fcbb6600640 1 -- start start 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb015cc80 0x7fcbb0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb00c86c0 0x7fcbb01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00cbb50 con 0x7fcb94003a00 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb015bb20 con 0x7fcbb015cc80 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.214+0000 7fcbb6600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00cbcd0 con 0x7fcbb00c86c0 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47646/0 (socket says 172.21.15.153:47646) 2024-09-17T03:16:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 -- 172.21.15.153:0/3254537988 learned_addr learned my addr 172.21.15.153:0/3254537988 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaea00640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb015cc80 0x7fcbb0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbafe00640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb00c86c0 0x7fcbb01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 -- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb00c86c0 msgr2=0x7fcbb01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb00c86c0 0x7fcbb01540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 -- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb015cc80 msgr2=0x7fcbb0153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb015cc80 0x7fcbb0153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 -- 172.21.15.153:0/3254537988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb00c8da0 con 0x7fcb94003a00 2024-09-17T03:16:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcbaf400640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009a70 tx=0x7fcba0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.215+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0038040 con 0x7fcb94003a00 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.216+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcba0004020 con 0x7fcb94003a00 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.216+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0004470 con 0x7fcb94003a00 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.216+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb00c9080 con 0x7fcb94003a00 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.216+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb00c9640 con 0x7fcb94003a00 2024-09-17T03:16:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.217+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb006dad0 con 0x7fcb94003a00 2024-09-17T03:16:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.218+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcba0045020 con 0x7fcb94003a00 2024-09-17T03:16:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.219+0000 7fcba7400640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 0x7fcb9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.219+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7fcba00bba00 con 0x7fcb94003a00 2024-09-17T03:16:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.219+0000 7fcbaea00640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 0x7fcb9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.220+0000 7fcbaea00640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 0x7fcb9007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c005eb0 tx=0x7fcb9c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.223+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcba0083b80 con 0x7fcb94003a00 2024-09-17T03:16:15.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.441+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbb006dde0 con 0x7fcb94003a00 2024-09-17T03:16:15.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.442+0000 7fcba7400640 1 -- 172.21.15.153:0/3254537988 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7fcba0083480 con 0x7fcb94003a00 2024-09-17T03:16:15.441 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:15.441 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:15.441 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 msgr2=0x7fcb9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 0x7fcb9007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c005eb0 tx=0x7fcb9c005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 msgr2=0x7fcbb015c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009a70 tx=0x7fcba0033670 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 shutdown_connections 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fcb90078b90 0x7fcb9007b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcbb00c86c0 0x7fcbb01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb015cc80 0x7fcbb0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 --2- 172.21.15.153:0/3254537988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94003a00 0x7fcbb015c740 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 >> 172.21.15.153:0/3254537988 conn(0x7fcbb00b34b0 msgr2=0x7fcbb015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 shutdown_connections 2024-09-17T03:16:15.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.444+0000 7fcbb6600640 1 -- 172.21.15.153:0/3254537988 wait complete. 2024-09-17T03:16:15.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:15.721 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":50,"msgr_send_messages":44,"msgr_recv_bytes":132067,"msgr_send_bytes":45401,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.015917700,"msgr_running_send_time":0.002937689,"msgr_running_recv_time":0.011542506,"msgr_running_fast_dispatch_time":0.000634403,"msgr_send_messages_queue_lat":{"avgcount":43,"sum":0.010434021,"avgtime":0.000242651},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":121696,"msgr_send_encrypted_bytes":7808},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":11,"msgr_recv_bytes":1386,"msgr_send_bytes":98997,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006294969,"msgr_running_send_time":0.000996850,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":10,"sum":0.007437839,"avgtime":0.000743783},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":52,"msgr_send_messages":40,"msgr_recv_bytes":28945,"msgr_send_bytes":14048,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.013952163,"msgr_running_send_time":0.003960196,"msgr_running_recv_time":0.008287893,"msgr_running_fast_dispatch_time":0.001684287,"msgr_send_messages_queue_lat":{"avgcount":39,"sum":0.016949665,"avgtime":0.000434606},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000004349,"avgtime":0.000000724},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":56,"sum":0.005821469,"avgtime":0.000103954}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199971,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.009623677,"avgtime":0.002405919},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":108496,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":714,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239923,"buffer_anon_items":76,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56360,"mds_co_items":260,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5754,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.121997880,"avgtime":0.002218143},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":64,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":103,"get_sum":150213,"get_or_fail_fail":0,"get_or_fail_success":103,"take":0,"take_sum":0,"put":103,"put_sum":150213,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6689,"put":55,"put_sum":6689,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4468,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4468,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:15.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 132067, "msgr_recv_encrypted_bytes": 121696, "msgr_recv_messages": 50, "msgr_running_fast_dispatch_time": 0.000634403, "msgr_running_recv_time": 0.011542506, "msgr_running_send_time": 0.002937689, "msgr_running_total_time": 0.0159177, "msgr_send_bytes": 45401, "msgr_send_encrypted_bytes": 7808, "msgr_send_messages": 44, "msgr_send_messages_queue_lat": { "avgcount": 43, "avgtime": 0.000242651, "sum": 0.010434021 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.00099685, "msgr_running_total_time": 0.006294969, "msgr_send_bytes": 98997, "msgr_send_encrypted_bytes": 97536, "msgr_send_messages": 11, "msgr_send_messages_queue_lat": { "avgcount": 10, "avgtime": 0.000743783, "sum": 0.007437839 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 7.24e-07, "sum": 4.349e-06 }, "msgr_recv_bytes": 28945, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 52, "msgr_running_fast_dispatch_time": 0.001684287, "msgr_running_recv_time": 0.008287893, "msgr_running_send_time": 0.003960196, "msgr_running_total_time": 0.013952163, "msgr_send_bytes": 14048, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 40, "msgr_send_messages_queue_lat": { "avgcount": 39, "avgtime": 0.000434606, "sum": 0.016949665 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 56, "avgtime": 0.000103954, "sum": 0.005821469 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002405919, "sum": 0.009623677 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199971 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 108496 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 714, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239923, "buffer_anon_items": 76, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56360, "mds_co_items": 260, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 64, "map_full": 0, "map_inc": 2, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.002218143, "sum": 0.12199788 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5754, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 103, "get_or_fail_fail": 0, "get_or_fail_success": 103, "get_started": 0, "get_sum": 150213, "max": 104857600, "put": 103, "put_sum": 150213, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6689, "take": 55, "take_sum": 6689, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4468, "max": 3758096384, "put": 4, "put_sum": 4468, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:15.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:16:15.723 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 -- 172.21.15.153:0/963117539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0708e0 msgr2=0x7ffbdc0cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 --2- 172.21.15.153:0/963117539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc0cf3f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0005fd0 tx=0x7ffbd002b9a0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 -- 172.21.15.153:0/963117539 shutdown_connections 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 --2- 172.21.15.153:0/963117539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc0cf3f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 -- 172.21.15.153:0/963117539 >> 172.21.15.153:0/963117539 conn(0x7ffbdc0b34b0 msgr2=0x7ffbdc0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 -- 172.21.15.153:0/963117539 shutdown_connections 2024-09-17T03:16:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.945+0000 7ffbe3600640 1 -- 172.21.15.153:0/963117539 wait complete. 2024-09-17T03:16:15.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.948+0000 7ffbe3600640 1 Processor -- start 2024-09-17T03:16:15.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.948+0000 7ffbe3600640 1 -- start start 2024-09-17T03:16:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffbdc06f5e0 0x7ffbdc159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc070300 con 0x7ffbdc0cf930 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc070180 con 0x7ffbdc0708e0 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe3600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc072e70 con 0x7ffbdc06f5e0 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.949+0000 7ffbe1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47678/0 (socket says 172.21.15.153:47678) 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 -- 172.21.15.153:0/3890658958 learned_addr learned my addr 172.21.15.153:0/3890658958 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe0c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffbdc06f5e0 0x7ffbdc159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbdbe00640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 -- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffbdc06f5e0 msgr2=0x7ffbdc159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffbdc06f5e0 0x7ffbdc159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 -- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbdc0708e0 msgr2=0x7ffbdc09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc09d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 -- 172.21.15.153:0/3890658958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc09c260 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe1600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4002230 tx=0x7ffbd400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4003b70 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd4003d10 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4005330 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.950+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc09c540 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.951+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc09cb00 con 0x7ffbdc0cf930 2024-09-17T03:16:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.952+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc15ac30 con 0x7ffbdc0cf930 2024-09-17T03:16:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.953+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffbd40056e0 con 0x7ffbdc0cf930 2024-09-17T03:16:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.954+0000 7ffbd8c00640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 0x7ffbbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.955+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7ffbd409ae20 con 0x7ffbdc0cf930 2024-09-17T03:16:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.955+0000 7ffbe0c00640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 0x7ffbbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.956+0000 7ffbe0c00640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 0x7ffbbc07b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0035000 tx=0x7ffbd003a040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:15.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:15.960+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffbd40629e0 con 0x7ffbdc0cf930 2024-09-17T03:16:16.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.176+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbdc0ae950 con 0x7ffbdc0cf930 2024-09-17T03:16:16.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.177+0000 7ffbd8c00640 1 -- 172.21.15.153:0/3890658958 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7ffbd4067410 con 0x7ffbdc0cf930 2024-09-17T03:16:16.176 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:16.176 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:16.176 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:16.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 msgr2=0x7ffbbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 0x7ffbbc07b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0035000 tx=0x7ffbd003a040 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 msgr2=0x7ffbdc09d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4002230 tx=0x7ffbd400cb90 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 shutdown_connections 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7ffbbc078bc0 0x7ffbbc07b0d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbdc0cf930 0x7ffbdc09d560 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbdc0708e0 0x7ffbdc09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 --2- 172.21.15.153:0/3890658958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffbdc06f5e0 0x7ffbdc159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.179+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 >> 172.21.15.153:0/3890658958 conn(0x7ffbdc0b34b0 msgr2=0x7ffbdc06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.180+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 shutdown_connections 2024-09-17T03:16:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.180+0000 7ffbe3600640 1 -- 172.21.15.153:0/3890658958 wait complete. 2024-09-17T03:16:16.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:16.442 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":50,"msgr_send_messages":44,"msgr_recv_bytes":132067,"msgr_send_bytes":45401,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.015917700,"msgr_running_send_time":0.002937689,"msgr_running_recv_time":0.011542506,"msgr_running_fast_dispatch_time":0.000634403,"msgr_send_messages_queue_lat":{"avgcount":43,"sum":0.010434021,"avgtime":0.000242651},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":121696,"msgr_send_encrypted_bytes":7808},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":11,"msgr_recv_bytes":1386,"msgr_send_bytes":98997,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006294969,"msgr_running_send_time":0.000996850,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":10,"sum":0.007437839,"avgtime":0.000743783},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":53,"msgr_send_messages":40,"msgr_recv_bytes":29347,"msgr_send_bytes":14048,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.014082280,"msgr_running_send_time":0.003990760,"msgr_running_recv_time":0.008346428,"msgr_running_fast_dispatch_time":0.001722085,"msgr_send_messages_queue_lat":{"avgcount":39,"sum":0.016949665,"avgtime":0.000434606},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000004349,"avgtime":0.000000724},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":56,"sum":0.005821469,"avgtime":0.000103954}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199971,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.009623677,"avgtime":0.002405919},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":108496,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":714,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239923,"buffer_anon_items":76,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56360,"mds_co_items":260,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5754,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.121997880,"avgtime":0.002218143},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":64,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":104,"get_sum":150541,"get_or_fail_fail":0,"get_or_fail_success":104,"take":0,"take_sum":0,"put":104,"put_sum":150541,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6689,"put":55,"put_sum":6689,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4468,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4468,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:16.443 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 132067, "msgr_recv_encrypted_bytes": 121696, "msgr_recv_messages": 50, "msgr_running_fast_dispatch_time": 0.000634403, "msgr_running_recv_time": 0.011542506, "msgr_running_send_time": 0.002937689, "msgr_running_total_time": 0.0159177, "msgr_send_bytes": 45401, "msgr_send_encrypted_bytes": 7808, "msgr_send_messages": 44, "msgr_send_messages_queue_lat": { "avgcount": 43, "avgtime": 0.000242651, "sum": 0.010434021 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.00099685, "msgr_running_total_time": 0.006294969, "msgr_send_bytes": 98997, "msgr_send_encrypted_bytes": 97536, "msgr_send_messages": 11, "msgr_send_messages_queue_lat": { "avgcount": 10, "avgtime": 0.000743783, "sum": 0.007437839 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 7.24e-07, "sum": 4.349e-06 }, "msgr_recv_bytes": 29347, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 53, "msgr_running_fast_dispatch_time": 0.001722085, "msgr_running_recv_time": 0.008346428, "msgr_running_send_time": 0.00399076, "msgr_running_total_time": 0.01408228, "msgr_send_bytes": 14048, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 40, "msgr_send_messages_queue_lat": { "avgcount": 39, "avgtime": 0.000434606, "sum": 0.016949665 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 56, "avgtime": 0.000103954, "sum": 0.005821469 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002405919, "sum": 0.009623677 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199971 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 108496 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 714, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239923, "buffer_anon_items": 76, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56360, "mds_co_items": 260, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 64, "map_full": 0, "map_inc": 2, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.002218143, "sum": 0.12199788 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5754, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 104, "get_or_fail_fail": 0, "get_or_fail_success": 104, "get_started": 0, "get_sum": 150541, "max": 104857600, "put": 104, "put_sum": 150541, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6689, "take": 55, "take_sum": 6689, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4468, "max": 3758096384, "put": 4, "put_sum": 4468, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:16.443 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:16:16.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 -- 172.21.15.153:0/3954755978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0d0c70 msgr2=0x7f9e6c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 --2- 172.21.15.153:0/3954755978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0d0c70 0x7f9e6c06d780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9e64005fd0 tx=0x7f9e6402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 -- 172.21.15.153:0/3954755978 shutdown_connections 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 --2- 172.21.15.153:0/3954755978 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0d0c70 0x7f9e6c06d780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 --2- 172.21.15.153:0/3954755978 >> v2:172.21.15.164:3300/0 conn(0x7f9e6c156e90 0x7f9e6c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.665+0000 7f9e73600640 1 -- 172.21.15.153:0/3954755978 >> 172.21.15.153:0/3954755978 conn(0x7f9e6c0b34b0 msgr2=0x7f9e6c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.666+0000 7f9e73600640 1 -- 172.21.15.153:0/3954755978 shutdown_connections 2024-09-17T03:16:16.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.666+0000 7f9e73600640 1 -- 172.21.15.153:0/3954755978 wait complete. 2024-09-17T03:16:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.668+0000 7f9e73600640 1 Processor -- start 2024-09-17T03:16:16.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.668+0000 7f9e73600640 1 -- start start 2024-09-17T03:16:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.669+0000 7f9e73600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e6c0cc450 0x7f9e6c0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.669+0000 7f9e73600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.669+0000 7f9e73600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0b11b0 0x7f9e6c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.669+0000 7f9e73600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c06e050 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e73600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c06ded0 con 0x7f9e6c0cc450 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e73600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c06e1d0 con 0x7f9e6c0b11b0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47684/0 (socket says 172.21.15.153:47684) 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 -- 172.21.15.153:0/1391065165 learned_addr learned my addr 172.21.15.153:0/1391065165 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e71600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0b11b0 0x7f9e6c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e70c00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e6c0cc450 0x7f9e6c0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 -- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0b11b0 msgr2=0x7f9e6c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0b11b0 0x7f9e6c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 -- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e6c0cc450 msgr2=0x7f9e6c0c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e6c0cc450 0x7f9e6c0c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.670+0000 7f9e63e00640 1 -- 172.21.15.153:0/1391065165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c0b1b00 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e63e00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400c430 tx=0x7f9e5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:16.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54011790 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c0c5400 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e54017070 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54011ce0 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.671+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c0c59c0 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.672+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c156e90 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.673+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e5401c460 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.674+0000 7f9e69600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 0x7f9e4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.674+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f9e5409aee0 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.675+0000 7f9e70c00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 0x7f9e4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:16.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.675+0000 7f9e70c00640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 0x7f9e4807b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009ac0 tx=0x7f9e5c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.679+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e6c0b1b00 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.898+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e6c06d560 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.899+0000 7f9e69600640 1 -- 172.21.15.153:0/1391065165 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f9e54062fe0 con 0x7f9e6c0cdcd0 2024-09-17T03:16:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:16.898 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 msgr2=0x7f9e4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 0x7f9e4807b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009ac0 tx=0x7f9e5c005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 msgr2=0x7f9e6c155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400c430 tx=0x7f9e5400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 shutdown_connections 2024-09-17T03:16:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9e48078b90 0x7f9e4807b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e6c0b11b0 0x7f9e6c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e6c0cdcd0 0x7f9e6c155ff0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 --2- 172.21.15.153:0/1391065165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e6c0cc450 0x7f9e6c0c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 >> 172.21.15.153:0/1391065165 conn(0x7f9e6c0b34b0 msgr2=0x7f9e6c0afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 shutdown_connections 2024-09-17T03:16:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:16.902+0000 7f9e73600640 1 -- 172.21.15.153:0/1391065165 wait complete. 2024-09-17T03:16:16.924 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-17T03:16:17.166 INFO:teuthology.orchestra.run.smithi164.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":51,"msgr_send_messages":45,"msgr_recv_bytes":132339,"msgr_send_bytes":46041,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.016084463,"msgr_running_send_time":0.003056074,"msgr_running_recv_time":0.011586046,"msgr_running_fast_dispatch_time":0.000634403,"msgr_send_messages_queue_lat":{"avgcount":44,"sum":0.010519273,"avgtime":0.000239074},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000225,"avgtime":0.000000112},"msgr_recv_encrypted_bytes":121968,"msgr_send_encrypted_bytes":8448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":6,"msgr_send_messages":11,"msgr_recv_bytes":1386,"msgr_send_bytes":98997,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006294969,"msgr_running_send_time":0.000996850,"msgr_running_recv_time":0.005001159,"msgr_running_fast_dispatch_time":0.000108459,"msgr_send_messages_queue_lat":{"avgcount":10,"sum":0.007437839,"avgtime":0.000743783},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":54,"msgr_send_messages":40,"msgr_recv_bytes":29749,"msgr_send_bytes":14048,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.014207376,"msgr_running_send_time":0.004009058,"msgr_running_recv_time":0.008414580,"msgr_running_fast_dispatch_time":0.001758386,"msgr_send_messages_queue_lat":{"avgcount":39,"sum":0.016949665,"avgtime":0.000434606},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000004349,"avgtime":0.000000724},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":56,"sum":0.005821469,"avgtime":0.000103954}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000106486,"avgtime":0.000026621}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199971,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.009623677,"avgtime":0.002405919},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":108496,"heap":349003776},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002728040,"avgtime":0.002728040},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":714,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239923,"buffer_anon_items":76,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56360,"mds_co_items":260,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5754,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.121997880,"avgtime":0.002218143},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":64,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":106,"get_sum":150999,"get_or_fail_fail":0,"get_or_fail_success":106,"take":0,"take_sum":0,"put":106,"put_sum":150999,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6689,"put":55,"put_sum":6689,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55f8bc6c5a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4468,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4468,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:16:17.167 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.12e-07, "sum": 2.25e-07 }, "msgr_recv_bytes": 132339, "msgr_recv_encrypted_bytes": 121968, "msgr_recv_messages": 51, "msgr_running_fast_dispatch_time": 0.000634403, "msgr_running_recv_time": 0.011586046, "msgr_running_send_time": 0.003056074, "msgr_running_total_time": 0.016084463, "msgr_send_bytes": 46041, "msgr_send_encrypted_bytes": 8448, "msgr_send_messages": 45, "msgr_send_messages_queue_lat": { "avgcount": 44, "avgtime": 0.000239074, "sum": 0.010519273 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 1386, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 6, "msgr_running_fast_dispatch_time": 0.000108459, "msgr_running_recv_time": 0.005001159, "msgr_running_send_time": 0.00099685, "msgr_running_total_time": 0.006294969, "msgr_send_bytes": 98997, "msgr_send_encrypted_bytes": 97536, "msgr_send_messages": 11, "msgr_send_messages_queue_lat": { "avgcount": 10, "avgtime": 0.000743783, "sum": 0.007437839 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 7.24e-07, "sum": 4.349e-06 }, "msgr_recv_bytes": 29749, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 54, "msgr_running_fast_dispatch_time": 0.001758386, "msgr_running_recv_time": 0.00841458, "msgr_running_send_time": 0.004009058, "msgr_running_total_time": 0.014207376, "msgr_send_bytes": 14048, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 40, "msgr_send_messages_queue_lat": { "avgcount": 39, "avgtime": 0.000434606, "sum": 0.016949665 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 56, "avgtime": 0.000103954, "sum": 0.005821469 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.6621e-05, "sum": 0.000106486 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002405919, "sum": 0.009623677 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199971 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 349003776, "ino": 14, "ino+": 14, "ino-": 0, "rss": 108496 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.00272804, "sum": 0.00272804 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 714, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239923, "buffer_anon_items": 76, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56360, "mds_co_items": 260, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 64, "map_full": 0, "map_inc": 2, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.002218143, "sum": 0.12199788 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5754, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 106, "get_or_fail_fail": 0, "get_or_fail_success": 106, "get_started": 0, "get_sum": 150999, "max": 104857600, "put": 106, "put_sum": 150999, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6689, "take": 55, "take_sum": 6689, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55f8bc6c5a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4468, "max": 3758096384, "put": 4, "put_sum": 4468, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:16:17.168 INFO:tasks.cephfs.test_openfiletable:omap_total_removes:1 2024-09-17T03:16:17.168 INFO:tasks.cephfs.test_openfiletable:omap_total_kv_pairs:1 2024-09-17T03:16:17.168 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:16:17.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:16:17.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:16:17.349 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:16:17.349 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:16:17.350 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:17.350 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:17.385 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:17.385 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:17.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 -- 172.21.15.153:0/1489159169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c0706e0 msgr2=0x7fe04c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 --2- 172.21.15.153:0/1489159169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c0706e0 0x7fe04c0ca7b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0d1210 tx=0x7fe03802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 -- 172.21.15.153:0/1489159169 shutdown_connections 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 --2- 172.21.15.153:0/1489159169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c0706e0 0x7fe04c0ca7b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 --2- 172.21.15.153:0/1489159169 >> v2:172.21.15.164:3300/0 conn(0x7fe04c06ed40 0x7fe04c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 -- 172.21.15.153:0/1489159169 >> 172.21.15.153:0/1489159169 conn(0x7fe04c0b1c50 msgr2=0x7fe04c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 -- 172.21.15.153:0/1489159169 shutdown_connections 2024-09-17T03:16:17.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.726+0000 7fe054600640 1 -- 172.21.15.153:0/1489159169 wait complete. 2024-09-17T03:16:17.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.728+0000 7fe054600640 1 Processor -- start 2024-09-17T03:16:17.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.729+0000 7fe054600640 1 -- start start 2024-09-17T03:16:17.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 0x7fe04c1e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe04c0706e0 0x7fe04c09f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c074690 con 0x7fe04c06ed40 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c074510 con 0x7fe04c06dd40 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe054600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe04c074810 con 0x7fe04c0706e0 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe051200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe051200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47694/0 (socket says 172.21.15.153:47694) 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe051200640 1 -- 172.21.15.153:0/2311530588 learned_addr learned my addr 172.21.15.153:0/2311530588 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.730+0000 7fe051c00640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 0x7fe04c1e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:17.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe052600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe04c0706e0 0x7fe04c09f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:17.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 -- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe04c0706e0 msgr2=0x7fe04c09f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:17.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe04c0706e0 0x7fe04c09f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 -- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 msgr2=0x7fe04c1e7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:17.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 0x7fe04c1e7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 -- 172.21.15.153:0/2311530588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c0a0770 con 0x7fe04c06ed40 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051c00640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 0x7fe04c1e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe051200640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe03802aa90 tx=0x7fe038033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038005c90 con 0x7fe04c06ed40 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.731+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe038031e50 con 0x7fe04c06ed40 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.732+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038005260 con 0x7fe04c06ed40 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.732+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c1e6a90 con 0x7fe04c06ed40 2024-09-17T03:16:17.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.732+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1e77d0 con 0x7fe04c06ed40 2024-09-17T03:16:17.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.733+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c074d30 con 0x7fe04c06ed40 2024-09-17T03:16:17.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.734+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe038005400 con 0x7fe04c06ed40 2024-09-17T03:16:17.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.735+0000 7fe049600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:17.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.735+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7fe0380bc060 con 0x7fe04c06ed40 2024-09-17T03:16:17.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.735+0000 7fe051c00640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:17.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.736+0000 7fe051c00640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 0x7fe02c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe040009f20 tx=0x7fe040005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:17.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.739+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe03803f030 con 0x7fe04c06ed40 2024-09-17T03:16:17.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.937+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe04c0b1a30 con 0x7fe04c06ed40 2024-09-17T03:16:17.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.937+0000 7fe049600640 1 -- 172.21.15.153:0/2311530588 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v64) ==== 80+0+124 (secure 0 0 0) 0x7fe038083b90 con 0x7fe04c06ed40 2024-09-17T03:16:17.936 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153:6834/1746730417 2024-09-18T03:15:57.669030+0000 2024-09-17T03:16:17.937 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153:6832/1746730417 2024-09-18T03:15:57.669030+0000 2024-09-17T03:16:17.937 INFO:teuthology.orchestra.run.smithi153.stderr:listed 2 entries 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.939+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 msgr2=0x7fe02c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.939+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 0x7fe02c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe040009f20 tx=0x7fe040005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.939+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 msgr2=0x7fe04c0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.939+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe03802aa90 tx=0x7fe038033c20 comp rx=0 tx=0).stop 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 shutdown_connections 2024-09-17T03:16:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe04c0706e0 0x7fe04c09f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe04c06ed40 0x7fe04c0cdd30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 --2- 172.21.15.153:0/2311530588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe04c06dd40 0x7fe04c1e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 >> 172.21.15.153:0/2311530588 conn(0x7fe04c0b1c50 msgr2=0x7fe04c158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 shutdown_connections 2024-09-17T03:16:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:17.940+0000 7fe054600640 1 -- 172.21.15.153:0/2311530588 wait complete. 2024-09-17T03:16:17.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:16:17.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:17.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:16:18.028 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:18.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:18.029 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:16:18.065 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:16:18.065 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:16:18.065 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:18.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:16:18.101 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:16:18.101 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:18.101 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:18.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:16:18.140 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:16:18.140 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:16:18.140 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:18.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:16:18.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:18.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 -- 172.21.15.153:0/1146603602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6694005250 msgr2=0x7f669400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 --2- 172.21.15.153:0/1146603602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6694005250 0x7f669400b9c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009ed0 tx=0x7f6694005830 comp rx=0 tx=0).stop 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 -- 172.21.15.153:0/1146603602 shutdown_connections 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 --2- 172.21.15.153:0/1146603602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6694005250 0x7f669400b9c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 -- 172.21.15.153:0/1146603602 >> 172.21.15.153:0/1146603602 conn(0x7f66ac0b34b0 msgr2=0x7f66ac0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 -- 172.21.15.153:0/1146603602 shutdown_connections 2024-09-17T03:16:18.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.402+0000 7f66b4800640 1 -- 172.21.15.153:0/1146603602 wait complete. 2024-09-17T03:16:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.404+0000 7f66b4800640 1 Processor -- start 2024-09-17T03:16:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.405+0000 7f66b4800640 1 -- start start 2024-09-17T03:16:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6694005250 0x7f66ac1f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ac1efe50 0x7f66ac1f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0d07f0 con 0x7f66ac1f6620 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0d0670 con 0x7f66ac1efe50 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b4800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac0d0970 con 0x7f6694005250 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47704/0 (socket says 172.21.15.153:47704) 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.406+0000 7f66b2800640 1 -- 172.21.15.153:0/813569711 learned_addr learned my addr 172.21.15.153:0/813569711 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b1e00640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6694005250 0x7f66ac1f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b1400640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ac1efe50 0x7f66ac1f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 -- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6694005250 msgr2=0x7f66ac1f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6694005250 0x7f66ac1f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 -- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ac1efe50 msgr2=0x7f66ac1f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ac1efe50 0x7f66ac1f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 -- 172.21.15.153:0/813569711 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac09d150 con 0x7f66ac1f6620 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b2800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009e20 tx=0x7f66a80042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a80046d0 con 0x7f66ac1f6620 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a803c440 con 0x7f66ac1f6620 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.407+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac09d430 con 0x7f66ac1f6620 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.408+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a803c870 con 0x7f66ac1f6620 2024-09-17T03:16:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.408+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac09d9f0 con 0x7f66ac1f6620 2024-09-17T03:16:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.409+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac0d0ed0 con 0x7f66ac1f6620 2024-09-17T03:16:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.410+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66a8045020 con 0x7f66ac1f6620 2024-09-17T03:16:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.411+0000 7f66a6000640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 0x7f669007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.412+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f66a80bbff0 con 0x7f66ac1f6620 2024-09-17T03:16:18.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.412+0000 7f66b1e00640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 0x7f669007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.413+0000 7f66b1e00640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 0x7f669007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000fb0 tx=0x7f66a00067a0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.416+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66a804c020 con 0x7f66ac1f6620 2024-09-17T03:16:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.636+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66ac0af5f0 con 0x7f66ac1f6620 2024-09-17T03:16:18.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.637+0000 7f66a6000640 1 -- 172.21.15.153:0/813569711 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f66a8084290 con 0x7f66ac1f6620 2024-09-17T03:16:18.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:18.638 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.639+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 msgr2=0x7f669007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.639+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 0x7f669007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000fb0 tx=0x7f66a00067a0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 msgr2=0x7f66ac1f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009e20 tx=0x7f66a80042d0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 shutdown_connections 2024-09-17T03:16:18.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f6690078b90 0x7f669007b0a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66ac1f6620 0x7f66ac1f6a30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66ac1efe50 0x7f66ac1f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 --2- 172.21.15.153:0/813569711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6694005250 0x7f66ac1f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 >> 172.21.15.153:0/813569711 conn(0x7f66ac0b34b0 msgr2=0x7f66ac0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 shutdown_connections 2024-09-17T03:16:18.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.640+0000 7f66b4800640 1 -- 172.21.15.153:0/813569711 wait complete. 2024-09-17T03:16:18.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 -- 172.21.15.153:0/3113872785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 msgr2=0x7f65d00cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3113872785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00cc450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009830 tx=0x7f65c802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 -- 172.21.15.153:0/3113872785 shutdown_connections 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3113872785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00cc450 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 -- 172.21.15.153:0/3113872785 >> 172.21.15.153:0/3113872785 conn(0x7f65d00b34b0 msgr2=0x7f65d00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 -- 172.21.15.153:0/3113872785 shutdown_connections 2024-09-17T03:16:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.884+0000 7f65d5c00640 1 -- 172.21.15.153:0/3113872785 wait complete. 2024-09-17T03:16:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.886+0000 7f65d5c00640 1 Processor -- start 2024-09-17T03:16:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.887+0000 7f65d5c00640 1 -- start start 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d00990a0 0x7f65d015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d015d130 0x7f65d015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65d006e220 con 0x7f65d00703b0 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f65d006e0a0 con 0x7f65d015d130 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65d5c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f65d006e3a0 con 0x7f65d00990a0 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65cea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65cea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47716/0 (socket says 172.21.15.153:47716) 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65cea00640 1 -- 172.21.15.153:0/3640056032 learned_addr learned my addr 172.21.15.153:0/3640056032 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65cf400640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d015d130 0x7f65d015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.888+0000 7f65ce000640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d00990a0 0x7f65d015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 -- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d00990a0 msgr2=0x7f65d015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d00990a0 0x7f65d015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 -- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d015d130 msgr2=0x7f65d015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d015d130 0x7f65d015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 -- 172.21.15.153:0/3640056032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d00cf5a0 con 0x7f65d00703b0 2024-09-17T03:16:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65cea00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f65c000cb50 tx=0x7f65c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0016020 con 0x7f65d00703b0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c000add0 con 0x7f65d00703b0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0012680 con 0x7f65d00703b0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d00cf880 con 0x7f65d00703b0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.889+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d015de70 con 0x7f65d00703b0 2024-09-17T03:16:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.891+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d0156e90 con 0x7f65d00703b0 2024-09-17T03:16:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.892+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65c0019020 con 0x7f65d00703b0 2024-09-17T03:16:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.893+0000 7f65c6a00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 0x7f65b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.893+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f65c009b470 con 0x7f65d00703b0 2024-09-17T03:16:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.894+0000 7f65ce000640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 0x7f65b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:18.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.894+0000 7f65ce000640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 0x7f65b007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65d006dbe0 tx=0x7f65bc009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:18.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:18.898+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65c0020020 con 0x7f65d00703b0 2024-09-17T03:16:19.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.116+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65d00744e0 con 0x7f65d00703b0 2024-09-17T03:16:19.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.117+0000 7f65c6a00640 1 -- 172.21.15.153:0/3640056032 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f65d00707c0 con 0x7f65d00703b0 2024-09-17T03:16:19.116 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:19.116 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:19.116 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:19.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 msgr2=0x7f65b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 0x7f65b007b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65d006dbe0 tx=0x7f65bc009040 comp rx=0 tx=0).stop 2024-09-17T03:16:19.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 msgr2=0x7f65d00c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f65c000cb50 tx=0x7f65c000a430 comp rx=0 tx=0).stop 2024-09-17T03:16:19.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 shutdown_connections 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f65b0078b90 0x7f65b007b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d015d130 0x7f65d015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d00990a0 0x7f65d015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 --2- 172.21.15.153:0/3640056032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65d00703b0 0x7f65d00c69e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 >> 172.21.15.153:0/3640056032 conn(0x7f65d00b34b0 msgr2=0x7f65d015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 shutdown_connections 2024-09-17T03:16:19.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.119+0000 7f65d5c00640 1 -- 172.21.15.153:0/3640056032 wait complete. 2024-09-17T03:16:19.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 -- 172.21.15.153:0/431011240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c0d35f0 msgr2=0x7f978c162320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 --2- 172.21.15.153:0/431011240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c0d35f0 0x7f978c162320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9784005fd0 tx=0x7f978402aaa0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 -- 172.21.15.153:0/431011240 shutdown_connections 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 --2- 172.21.15.153:0/431011240 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c0d35f0 0x7f978c162320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 --2- 172.21.15.153:0/431011240 >> v2:172.21.15.164:3300/0 conn(0x7f978c0b37d0 0x7f978c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.361+0000 7f9791400640 1 -- 172.21.15.153:0/431011240 >> 172.21.15.153:0/431011240 conn(0x7f978c0d4960 msgr2=0x7f978c0b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.362+0000 7f9791400640 1 -- 172.21.15.153:0/431011240 shutdown_connections 2024-09-17T03:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.362+0000 7f9791400640 1 -- 172.21.15.153:0/431011240 wait complete. 2024-09-17T03:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.364+0000 7f9791400640 1 Processor -- start 2024-09-17T03:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.364+0000 7f9791400640 1 -- start start 2024-09-17T03:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 0x7f978c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 0x7f978c0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f978c162bf0 con 0x7f978c15e4f0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f978c162a70 con 0x7f978c0b37d0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.365+0000 7f9791400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f978c162d70 con 0x7f978c1f5a10 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47732/0 (socket says 172.21.15.153:47732) 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 -- 172.21.15.153:0/2773273876 learned_addr learned my addr 172.21.15.153:0/2773273876 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9790a00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 0x7f978c0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f978be00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 0x7f978c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 -- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 msgr2=0x7f978c0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 0x7f978c0b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 -- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 msgr2=0x7f978c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 0x7f978c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9783400640 1 -- 172.21.15.153:0/2773273876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c0b59c0 con 0x7f978c15e4f0 2024-09-17T03:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f9790a00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 0x7f978c0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.366+0000 7f978be00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 0x7f978c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9783400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f977400c370 tx=0x7f977400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774017070 con 0x7f978c15e4f0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97740053c0 con 0x7f978c15e4f0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c0b5c80 con 0x7f978c15e4f0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774003870 con 0x7f978c15e4f0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.367+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c0b3fb0 con 0x7f978c15e4f0 2024-09-17T03:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.368+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c1f5f60 con 0x7f978c15e4f0 2024-09-17T03:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.369+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f977401a070 con 0x7f978c15e4f0 2024-09-17T03:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.370+0000 7f9788c00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 0x7f976807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.370+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f977409a230 con 0x7f978c15e4f0 2024-09-17T03:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.371+0000 7f978be00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 0x7f976807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.372+0000 7f978be00640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 0x7f976807b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f977c0095f0 tx=0x7f977c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.375+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9774061e00 con 0x7f978c15e4f0 2024-09-17T03:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.559+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f978c0d0610 con 0x7f978c15e4f0 2024-09-17T03:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.560+0000 7f9788c00640 1 -- 172.21.15.153:0/2773273876 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17204 (secure 0 0 0) 0x7f9774066830 con 0x7f978c15e4f0 2024-09-17T03:16:19.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:19.560 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":64,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:16:12.740228+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:15:46.001140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:15:47.065591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.4","mappings":[{"from":2,"to":5}]},{"pgid":"8.23","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/1746730417":"2024-09-18T03:15:57.669030+0000","172.21.15.153:6832/1746730417":"2024-09-18T03:15:57.669030+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 msgr2=0x7f976807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 0x7f976807b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f977c0095f0 tx=0x7f977c005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 msgr2=0x7f978c0b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f977400c370 tx=0x7f977400c830 comp rx=0 tx=0).stop 2024-09-17T03:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 shutdown_connections 2024-09-17T03:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f9768078b90 0x7f976807b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f978c1f5a10 0x7f978c0b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f978c15e4f0 0x7f978c0b44d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 --2- 172.21.15.153:0/2773273876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f978c0b37d0 0x7f978c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 >> 172.21.15.153:0/2773273876 conn(0x7f978c0d4960 msgr2=0x7f978c0b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:19.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 shutdown_connections 2024-09-17T03:16:19.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.563+0000 7f9791400640 1 -- 172.21.15.153:0/2773273876 wait complete. 2024-09-17T03:16:19.585 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:16:19.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 -- 172.21.15.153:0/3772057743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1c004800 msgr2=0x7fda1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 --2- 172.21.15.153:0/3772057743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1c004800 0x7fda1c004c10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c310 tx=0x7fda1c005830 comp rx=0 tx=0).stop 2024-09-17T03:16:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 -- 172.21.15.153:0/3772057743 shutdown_connections 2024-09-17T03:16:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 --2- 172.21.15.153:0/3772057743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda1c004800 0x7fda1c004c10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 -- 172.21.15.153:0/3772057743 >> 172.21.15.153:0/3772057743 conn(0x7fda380b34b0 msgr2=0x7fda380b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 -- 172.21.15.153:0/3772057743 shutdown_connections 2024-09-17T03:16:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.813+0000 7fda3ec00640 1 -- 172.21.15.153:0/3772057743 wait complete. 2024-09-17T03:16:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.815+0000 7fda3ec00640 1 Processor -- start 2024-09-17T03:16:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.815+0000 7fda3ec00640 1 -- start start 2024-09-17T03:16:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c004800 0x7fda380998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3815f300 0x7fda380cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda380703b0 con 0x7fda380b21b0 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fda381570a0 con 0x7fda1c004800 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3ec00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fda38070530 con 0x7fda3815f300 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda37400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda37400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47750/0 (socket says 172.21.15.153:47750) 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda37400640 1 -- 172.21.15.153:0/414340357 learned_addr learned my addr 172.21.15.153:0/414340357 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda37e00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c004800 0x7fda380998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.817+0000 7fda3cc00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3815f300 0x7fda380cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 -- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3815f300 msgr2=0x7fda380cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3815f300 0x7fda380cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 -- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c004800 msgr2=0x7fda380998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c004800 0x7fda380998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 -- 172.21.15.153:0/414340357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3815f710 con 0x7fda380b21b0 2024-09-17T03:16:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda37400640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda2402b180 tx=0x7fda24004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24031040 con 0x7fda380b21b0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda24006420 con 0x7fda380b21b0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3815b760 con 0x7fda380b21b0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24001d10 con 0x7fda380b21b0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.818+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3815bd20 con 0x7fda380b21b0 2024-09-17T03:16:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.820+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda380d0560 con 0x7fda380b21b0 2024-09-17T03:16:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.821+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda24034070 con 0x7fda380b21b0 2024-09-17T03:16:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.822+0000 7fda2fe00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 0x7fda1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.822+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7fda240bb2a0 con 0x7fda380b21b0 2024-09-17T03:16:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.822+0000 7fda37e00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 0x7fda1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.823+0000 7fda37e00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 0x7fda1807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fda3806bc00 tx=0x7fda28005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:19.826+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda3815f710 con 0x7fda380b21b0 2024-09-17T03:16:20.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.043+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda3806dd20 con 0x7fda380b21b0 2024-09-17T03:16:20.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.044+0000 7fda2fe00640 1 -- 172.21.15.153:0/414340357 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7fda240834b0 con 0x7fda380b21b0 2024-09-17T03:16:20.044 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:20.044 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:20.044 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:20.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 msgr2=0x7fda1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 0x7fda1807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fda3806bc00 tx=0x7fda28005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 msgr2=0x7fda3815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda2402b180 tx=0x7fda24004be0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 shutdown_connections 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fda18078b90 0x7fda1807b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda3815f300 0x7fda380cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda380b21b0 0x7fda3815edc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 --2- 172.21.15.153:0/414340357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c004800 0x7fda380998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.046+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 >> 172.21.15.153:0/414340357 conn(0x7fda380b34b0 msgr2=0x7fda380b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:20.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.047+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 shutdown_connections 2024-09-17T03:16:20.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.047+0000 7fda3ec00640 1 -- 172.21.15.153:0/414340357 wait complete. 2024-09-17T03:16:20.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:20.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 -- 172.21.15.153:0/847719207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f40003a00 msgr2=0x7f1f40003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 --2- 172.21.15.153:0/847719207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f40003a00 0x7f1f40003e70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c610 tx=0x7f1f40005830 comp rx=0 tx=0).stop 2024-09-17T03:16:20.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61000640 1 -- 172.21.15.153:0/847719207 reap_dead start 2024-09-17T03:16:20.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 -- 172.21.15.153:0/847719207 shutdown_connections 2024-09-17T03:16:20.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 -- 172.21.15.153:0/847719207 >> 172.21.15.153:0/847719207 conn(0x7f1f5c0cfed0 msgr2=0x7f1f5c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:20.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 -- 172.21.15.153:0/847719207 shutdown_connections 2024-09-17T03:16:20.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.290+0000 7f1f61a00640 1 -- 172.21.15.153:0/847719207 wait complete. 2024-09-17T03:16:20.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.292+0000 7f1f61a00640 1 Processor -- start 2024-09-17T03:16:20.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.292+0000 7f1f61a00640 1 -- start start 2024-09-17T03:16:20.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f40003a00 0x7f1f5c1f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f5c073900 0x7f1f5c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0cecd0 con 0x7f1f5c074570 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0ceb50 con 0x7f1f5c073900 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0cee50 con 0x7f1f40003a00 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47778/0 (socket says 172.21.15.153:47778) 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f61000640 1 -- 172.21.15.153:0/1579914817 learned_addr learned my addr 172.21.15.153:0/1579914817 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f5be00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f40003a00 0x7f1f5c1f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.294+0000 7f1f53400640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f5c073900 0x7f1f5c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 -- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f40003a00 msgr2=0x7f1f5c1f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f40003a00 0x7f1f5c1f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 -- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f5c073900 msgr2=0x7f1f5c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f5c073900 0x7f1f5c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 -- 172.21.15.153:0/1579914817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c074ec0 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61000640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0d0e30 tx=0x7f1f54011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54004440 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f54005020 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c074030 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54005470 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.295+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c0adb40 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.296+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c073da0 con 0x7f1f5c074570 2024-09-17T03:16:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.298+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f540047a0 con 0x7f1f5c074570 2024-09-17T03:16:20.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.299+0000 7f1f58c00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 0x7f1f3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.299+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f1f5409ba30 con 0x7f1f5c074570 2024-09-17T03:16:20.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.300+0000 7f1f5be00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 0x7f1f3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.300+0000 7f1f5be00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 0x7f1f3807b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c610 tx=0x7f1f4c038040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:20.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.304+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f5401f060 con 0x7f1f5c074570 2024-09-17T03:16:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.521+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f5c06ce60 con 0x7f1f5c074570 2024-09-17T03:16:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.522+0000 7f1f58c00640 1 -- 172.21.15.153:0/1579914817 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f1f5c074ec0 con 0x7f1f5c074570 2024-09-17T03:16:20.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:20.521 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":41,"btime":"2024-09-17T03:16:01:700621+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:15:48.101975+0000","modified":"2024-09-17T03:16:01.700614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.164:6836/1937223305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1937223305},{"type":"v1","addr":"172.21.15.164:6836","nonce":1937223305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":3}]} 2024-09-17T03:16:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 41 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.524+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 msgr2=0x7f1f3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.524+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 0x7f1f3807b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c610 tx=0x7f1f4c038040 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.524+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 msgr2=0x7f1f5c074980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.524+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0d0e30 tx=0x7f1f54011a90 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 shutdown_connections 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f38078bc0 0x7f1f3807b0d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f5c074570 0x7f1f5c074980 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f5c073900 0x7f1f5c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 --2- 172.21.15.153:0/1579914817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1f40003a00 0x7f1f5c1f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 >> 172.21.15.153:0/1579914817 conn(0x7f1f5c0cfed0 msgr2=0x7f1f5c0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 shutdown_connections 2024-09-17T03:16:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.525+0000 7f1f61a00640 1 -- 172.21.15.153:0/1579914817 wait complete. 2024-09-17T03:16:20.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.773+0000 7f4038c00640 1 -- 172.21.15.153:0/4268396172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 msgr2=0x7f4018004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.773+0000 7f4038c00640 1 --2- 172.21.15.153:0/4268396172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4018004800 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f401c001830 tx=0x7f4018005830 comp rx=0 tx=0).stop 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.774+0000 7f4032800640 1 -- 172.21.15.153:0/4268396172 reap_dead start 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.774+0000 7f4038c00640 1 -- 172.21.15.153:0/4268396172 shutdown_connections 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.774+0000 7f4038c00640 1 -- 172.21.15.153:0/4268396172 >> 172.21.15.153:0/4268396172 conn(0x7f40340b34b0 msgr2=0x7f40340b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.774+0000 7f4038c00640 1 -- 172.21.15.153:0/4268396172 shutdown_connections 2024-09-17T03:16:20.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.774+0000 7f4038c00640 1 -- 172.21.15.153:0/4268396172 wait complete. 2024-09-17T03:16:20.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.776+0000 7f4038c00640 1 Processor -- start 2024-09-17T03:16:20.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.776+0000 7f4038c00640 1 -- start start 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.777+0000 7f4038c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.777+0000 7f4038c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 0x7f403415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.777+0000 7f4038c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 0x7f403415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4038c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40340cc7e0 con 0x7f40180041c0 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4038c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f40340cc660 con 0x7f403415f4a0 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4038c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f403406de90 con 0x7f403415d1a0 2024-09-17T03:16:20.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47794/0 (socket says 172.21.15.153:47794) 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 -- 172.21.15.153:0/2164121548 learned_addr learned my addr 172.21.15.153:0/2164121548 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4029400640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 0x7f403415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4032800640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 0x7f403415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 -- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 msgr2=0x7f403415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 0x7f403415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 -- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 msgr2=0x7f403415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 0x7f403415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4031e00640 1 -- 172.21.15.153:0/2164121548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40340c5b80 con 0x7f40180041c0 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4029400640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 0x7f403415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.778+0000 7f4032800640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 0x7f403415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:20.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.779+0000 7f4031e00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40240019f0 tx=0x7f4024003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:20.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.779+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024015070 con 0x7f40180041c0 2024-09-17T03:16:20.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.780+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f402400fa80 con 0x7f40180041c0 2024-09-17T03:16:20.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.780+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40340c5e20 con 0x7f40180041c0 2024-09-17T03:16:20.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.780+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024011430 con 0x7f40180041c0 2024-09-17T03:16:20.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.780+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40340c63e0 con 0x7f40180041c0 2024-09-17T03:16:20.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.781+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403406e420 con 0x7f40180041c0 2024-09-17T03:16:20.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.782+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40240115d0 con 0x7f40180041c0 2024-09-17T03:16:20.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.783+0000 7f402aa00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 0x7f401007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:20.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.783+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7f402409bf50 con 0x7f40180041c0 2024-09-17T03:16:20.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.783+0000 7f4029400640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 0x7f401007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:20.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.784+0000 7f4029400640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 0x7f401007b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f401c032000 tx=0x7f401c001360 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:20.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.788+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40340707c0 con 0x7f40180041c0 2024-09-17T03:16:20.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.972+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f403406d560 con 0x7f40180041c0 2024-09-17T03:16:20.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.974+0000 7f402aa00640 1 -- 172.21.15.153:0/2164121548 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17204 (secure 0 0 0) 0x7f40240640d0 con 0x7f40180041c0 2024-09-17T03:16:20.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:20.973 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":64,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:16:12.740228+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:15:46.001140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:15:47.065591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.4","mappings":[{"from":2,"to":5}]},{"pgid":"8.23","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/1746730417":"2024-09-18T03:15:57.669030+0000","172.21.15.153:6832/1746730417":"2024-09-18T03:15:57.669030+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 msgr2=0x7f401007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 0x7f401007b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f401c032000 tx=0x7f401c001360 comp rx=0 tx=0).stop 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 msgr2=0x7f4034154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40240019f0 tx=0x7f4024003a80 comp rx=0 tx=0).stop 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 shutdown_connections 2024-09-17T03:16:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f4010078b90 0x7f401007b0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f403415d1a0 0x7f403415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f403415f4a0 0x7f403415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 --2- 172.21.15.153:0/2164121548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40180041c0 0x7f4034154b20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 >> 172.21.15.153:0/2164121548 conn(0x7f40340b34b0 msgr2=0x7f403406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 shutdown_connections 2024-09-17T03:16:20.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:20.976+0000 7f4038c00640 1 -- 172.21.15.153:0/2164121548 wait complete. 2024-09-17T03:16:21.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:16:21.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 -- 172.21.15.153:0/508160526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc0cb500 msgr2=0x7fb2fc15d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 --2- 172.21.15.153:0/508160526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc0cb500 0x7fb2fc15d570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4005fd0 tx=0x7fb2f402ab40 comp rx=0 tx=0).stop 2024-09-17T03:16:21.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 -- 172.21.15.153:0/508160526 shutdown_connections 2024-09-17T03:16:21.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 --2- 172.21.15.153:0/508160526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc0cb500 0x7fb2fc15d570 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 -- 172.21.15.153:0/508160526 >> 172.21.15.153:0/508160526 conn(0x7fb2fc0cc910 msgr2=0x7fb2fc0ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:21.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 -- 172.21.15.153:0/508160526 shutdown_connections 2024-09-17T03:16:21.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.224+0000 7fb301400640 1 -- 172.21.15.153:0/508160526 wait complete. 2024-09-17T03:16:21.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.226+0000 7fb301400640 1 Processor -- start 2024-09-17T03:16:21.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.226+0000 7fb301400640 1 -- start start 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 0x7fb2fc1e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 0x7fb2fc1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc0c5db0 con 0x7fb2fc1e5880 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc0c5c30 con 0x7fb2fc15d160 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb301400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb2fc0c5f30 con 0x7fb2fc073db0 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47804/0 (socket says 172.21.15.153:47804) 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 -- 172.21.15.153:0/301063189 learned_addr learned my addr 172.21.15.153:0/301063189 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb2f3400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 0x7fb2fc1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb2fbe00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 0x7fb2fc1e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 -- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 msgr2=0x7fb2fc1e6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 0x7fb2fc1e6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 -- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 msgr2=0x7fb2fc1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 0x7fb2fc1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb300a00640 1 -- 172.21.15.153:0/301063189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2fc1e6790 con 0x7fb2fc1e5880 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb2f3400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 0x7fb2fc1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.228+0000 7fb2fbe00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 0x7fb2fc1e6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb300a00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009d90 tx=0x7fb2f402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4044070 con 0x7fb2fc1e5880 2024-09-17T03:16:21.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2f4004250 con 0x7fb2fc1e5880 2024-09-17T03:16:21.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2fc1e6c10 con 0x7fb2fc1e5880 2024-09-17T03:16:21.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40046a0 con 0x7fb2fc1e5880 2024-09-17T03:16:21.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.229+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2fc1e5080 con 0x7fb2fc1e5880 2024-09-17T03:16:21.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.230+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2fc1e6960 con 0x7fb2fc1e5880 2024-09-17T03:16:21.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.231+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2f4036400 con 0x7fb2fc1e5880 2024-09-17T03:16:21.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.232+0000 7fb2f8c00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 0x7fb2d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.232+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6245+0+0 (secure 0 0 0) 0x7fb2f40bb950 con 0x7fb2fc1e5880 2024-09-17T03:16:21.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.233+0000 7fb2fbe00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 0x7fb2d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.234+0000 7fb2fbe00640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 0x7fb2d807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007fd0 tx=0x7fb2ec009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:21.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.237+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb2f4032030 con 0x7fb2fc1e5880 2024-09-17T03:16:21.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.458+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb2fc15d570 con 0x7fb2fc1e5880 2024-09-17T03:16:21.458 INFO:tasks.ceph.mon.a.smithi153.stderr:2024-09-17T03:16:21.459+0000 7f8431a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:16:21.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.461+0000 7fb2f8c00640 1 -- 172.21.15.153:0/301063189 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7fb2f4083ad0 con 0x7fb2fc1e5880 2024-09-17T03:16:21.460 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:16:21.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 msgr2=0x7fb2d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 0x7fb2d807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007fd0 tx=0x7fb2ec009040 comp rx=0 tx=0).stop 2024-09-17T03:16:21.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 msgr2=0x7fb2fc0ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009d90 tx=0x7fb2f402c8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 shutdown_connections 2024-09-17T03:16:21.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb2d8078b90 0x7fb2d807b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2fc1e5880 0x7fb2fc0ceab0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2fc15d160 0x7fb2fc1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 --2- 172.21.15.153:0/301063189 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb2fc073db0 0x7fb2fc1e6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 >> 172.21.15.153:0/301063189 conn(0x7fb2fc0cc910 msgr2=0x7fb2fc0ca430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:21.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 shutdown_connections 2024-09-17T03:16:21.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.464+0000 7fb301400640 1 -- 172.21.15.153:0/301063189 wait complete. 2024-09-17T03:16:21.471 INFO:tasks.ceph.mds.b.smithi164.stderr: -1409> 2024-09-17T03:16:02.685+0000 7f869d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:16:21.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:16:21.588 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-09-17T03:16:21.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 -- 172.21.15.153:0/3442720980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 msgr2=0x7feb380cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 --2- 172.21.15.153:0/3442720980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb380cfab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb30009be0 tx=0x7feb3002a920 comp rx=0 tx=0).stop 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 -- 172.21.15.153:0/3442720980 shutdown_connections 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 --2- 172.21.15.153:0/3442720980 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb380cfab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 -- 172.21.15.153:0/3442720980 >> 172.21.15.153:0/3442720980 conn(0x7feb380cd480 msgr2=0x7feb380cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 -- 172.21.15.153:0/3442720980 shutdown_connections 2024-09-17T03:16:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.714+0000 7feb3d200640 1 -- 172.21.15.153:0/3442720980 wait complete. 2024-09-17T03:16:21.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.717+0000 7feb3d200640 1 Processor -- start 2024-09-17T03:16:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.717+0000 7feb3d200640 1 -- start start 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb380cba60 0x7feb381539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb38159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb3816a040 con 0x7feb3806e6c0 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb380d0240 con 0x7feb380cba60 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb3d200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7feb3816a1c0 con 0x7feb380cf6a0 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb35e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb35e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47820/0 (socket says 172.21.15.153:47820) 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.718+0000 7feb35e00640 1 -- 172.21.15.153:0/2691305272 learned_addr learned my addr 172.21.15.153:0/2691305272 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb2d400640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb380cba60 0x7feb381539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb36800640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb38159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 -- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 msgr2=0x7feb38159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb38159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 -- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb380cba60 msgr2=0x7feb381539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb380cba60 0x7feb381539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 -- 172.21.15.153:0/2691305272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb380b5340 con 0x7feb3806e6c0 2024-09-17T03:16:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb36800640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb38159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb35e00640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c460 tx=0x7feb2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.719+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28016020 con 0x7feb3806e6c0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.720+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb28012a00 con 0x7feb3806e6c0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.720+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb380b5620 con 0x7feb3806e6c0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.720+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28012e50 con 0x7feb3806e6c0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.720+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb380b5be0 con 0x7feb3806e6c0 2024-09-17T03:16:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.721+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb380c4010 con 0x7feb3806e6c0 2024-09-17T03:16:21.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.722+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb28019020 con 0x7feb3806e6c0 2024-09-17T03:16:21.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.723+0000 7feb2ea00640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 0x7feb1407b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:21.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.723+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6331+0+0 (secure 0 0 0) 0x7feb2809ab30 con 0x7feb3806e6c0 2024-09-17T03:16:21.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.723+0000 7feb2d400640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 0x7feb1407b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:21.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.724+0000 7feb2d400640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 0x7feb1407b270 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb381f8c70 tx=0x7feb20009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.728+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb380c4010 con 0x7feb3806e6c0 2024-09-17T03:16:21.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:21.949+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb380b0a90 con 0x7feb3806e6c0 2024-09-17T03:16:22.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.463+0000 7feb2ea00640 1 -- 172.21.15.153:0/2691305272 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7feb380b0a90 con 0x7feb3806e6c0 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 msgr2=0x7feb1407b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 0x7feb1407b270 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb381f8c70 tx=0x7feb20009040 comp rx=0 tx=0).stop 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 msgr2=0x7feb380b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c460 tx=0x7feb2800c920 comp rx=0 tx=0).stop 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 shutdown_connections 2024-09-17T03:16:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7feb14078d60 0x7feb1407b270 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feb380cf6a0 0x7feb38159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb380cba60 0x7feb381539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 --2- 172.21.15.153:0/2691305272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb3806e6c0 0x7feb380b63e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 >> 172.21.15.153:0/2691305272 conn(0x7feb380cd480 msgr2=0x7feb380cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 shutdown_connections 2024-09-17T03:16:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.466+0000 7feb3d200640 1 -- 172.21.15.153:0/2691305272 wait complete. 2024-09-17T03:16:22.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:16:22.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 -- 172.21.15.153:0/288784083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 msgr2=0x7f820c0ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:22.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 --2- 172.21.15.153:0/288784083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0ca780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f81fc005fd0 tx=0x7f81fc02a540 comp rx=0 tx=0).stop 2024-09-17T03:16:22.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 -- 172.21.15.153:0/288784083 shutdown_connections 2024-09-17T03:16:22.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 --2- 172.21.15.153:0/288784083 >> v2:172.21.15.164:3300/0 conn(0x7f820c06e400 0x7f820c166240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 --2- 172.21.15.153:0/288784083 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0ca780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 -- 172.21.15.153:0/288784083 >> 172.21.15.153:0/288784083 conn(0x7f820c0b1c20 msgr2=0x7f820c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:22.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 -- 172.21.15.153:0/288784083 shutdown_connections 2024-09-17T03:16:22.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.719+0000 7f8212e00640 1 -- 172.21.15.153:0/288784083 wait complete. 2024-09-17T03:16:22.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.721+0000 7f8212e00640 1 Processor -- start 2024-09-17T03:16:22.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.721+0000 7f8212e00640 1 -- start start 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f820c06e400 0x7f820c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f820c166b10 con 0x7f820c072fe0 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f820c166990 con 0x7f820c06e400 2024-09-17T03:16:22.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8212e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f820c166c90 con 0x7f820c074a40 2024-09-17T03:16:22.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f820b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:22.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f820b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47824/0 (socket says 172.21.15.153:47824) 2024-09-17T03:16:22.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f820b400640 1 -- 172.21.15.153:0/1958318606 learned_addr learned my addr 172.21.15.153:0/1958318606 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:22.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f820be00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f820c06e400 0x7f820c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:22.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.723+0000 7f8210e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 -- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 msgr2=0x7f820c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 -- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f820c06e400 msgr2=0x7f820c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f820c06e400 0x7f820c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 -- 172.21.15.153:0/1958318606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c15b5c0 con 0x7f820c072fe0 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f820b400640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c3a0 tx=0x7f81f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8017070 con 0x7f820c072fe0 2024-09-17T03:16:22.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81f80053c0 con 0x7f820c072fe0 2024-09-17T03:16:22.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c15b8a0 con 0x7f820c072fe0 2024-09-17T03:16:22.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8003850 con 0x7f820c072fe0 2024-09-17T03:16:22.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.724+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c15be60 con 0x7f820c072fe0 2024-09-17T03:16:22.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.725+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c0ca780 con 0x7f820c072fe0 2024-09-17T03:16:22.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.727+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81f801a070 con 0x7f820c072fe0 2024-09-17T03:16:22.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.728+0000 7f8203e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 0x7f81ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:22.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.728+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6331+0+0 (secure 0 0 0) 0x7f81f809a370 con 0x7f820c072fe0 2024-09-17T03:16:22.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.728+0000 7f820be00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 0x7f81ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:22.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.729+0000 7f820be00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 0x7f81ec07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f81fc033000 tx=0x7f81fc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:22.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.732+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81f8061e50 con 0x7f820c072fe0 2024-09-17T03:16:22.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:22.921+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f820c15d480 con 0x7f820c072fe0 2024-09-17T03:16:23.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:23.040 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:23.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.809+0000 7f8203e00640 1 -- 172.21.15.153:0/1958318606 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7f81f8066880 con 0x7f820c072fe0 2024-09-17T03:16:23.808 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:16:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.812+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 msgr2=0x7f81ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.812+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 0x7f81ec07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f81fc033000 tx=0x7f81fc004730 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.812+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 msgr2=0x7f820c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.812+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c3a0 tx=0x7f81f800c860 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 shutdown_connections 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f81ec078b90 0x7f81ec07b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f820c074a40 0x7f820c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f820c072fe0 0x7f820c0b2f80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 --2- 172.21.15.153:0/1958318606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f820c06e400 0x7f820c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 >> 172.21.15.153:0/1958318606 conn(0x7f820c0b1c20 msgr2=0x7f820c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 shutdown_connections 2024-09-17T03:16:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:23.813+0000 7f8212e00640 1 -- 172.21.15.153:0/1958318606 wait complete. 2024-09-17T03:16:23.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:16:24.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 -- 172.21.15.153:0/2159326963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd850004d40 msgr2=0x7fd850005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 --2- 172.21.15.153:0/2159326963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd850004d40 0x7fd850005190 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd860005fd0 tx=0x7fd850005830 comp rx=0 tx=0).stop 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86e200640 1 -- 172.21.15.153:0/2159326963 reap_dead start 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 -- 172.21.15.153:0/2159326963 shutdown_connections 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 -- 172.21.15.153:0/2159326963 >> 172.21.15.153:0/2159326963 conn(0x7fd8680b1be0 msgr2=0x7fd8680b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 -- 172.21.15.153:0/2159326963 shutdown_connections 2024-09-17T03:16:24.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.070+0000 7fd86ec00640 1 -- 172.21.15.153:0/2159326963 wait complete. 2024-09-17T03:16:24.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.072+0000 7fd86ec00640 1 Processor -- start 2024-09-17T03:16:24.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.073+0000 7fd86ec00640 1 -- start start 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd850004d40 0x7fd8680aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8680cff60 0x7fd8680d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd86806d850 con 0x7fd8680aed50 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd86806d6d0 con 0x7fd850004d40 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ec00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd86806d9d0 con 0x7fd8680cff60 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ce00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33850/0 (socket says 172.21.15.153:33850) 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.074+0000 7fd86ce00640 1 -- 172.21.15.153:0/3048239154 learned_addr learned my addr 172.21.15.153:0/3048239154 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86d800640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd850004d40 0x7fd8680aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:24.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86e200640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8680cff60 0x7fd8680d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:24.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 -- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8680cff60 msgr2=0x7fd8680d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:24.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8680cff60 0x7fd8680d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 -- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd850004d40 msgr2=0x7fd8680aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:24.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd850004d40 0x7fd8680aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 -- 172.21.15.153:0/3048239154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8680d08b0 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ce00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd85400f7f0 tx=0x7fd85400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85400bcb0 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd854011440 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681f5180 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.075+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854011850 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.076+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681f5740 con 0x7fd8680aed50 2024-09-17T03:16:24.076 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.077+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86815ffc0 con 0x7fd8680aed50 2024-09-17T03:16:24.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.078+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd854019020 con 0x7fd8680aed50 2024-09-17T03:16:24.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.079+0000 7fd865600640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 0x7fd84807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:24.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.079+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5893+0+0 (secure 0 0 0) 0x7fd85409b660 con 0x7fd8680aed50 2024-09-17T03:16:24.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.079+0000 7fd86d800640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 0x7fd84807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:24.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.080+0000 7fd86d800640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 0x7fd84807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd85c001a30 tx=0x7fd85c0015c0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:24.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.083+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8680d08b0 con 0x7fd8680aed50 2024-09-17T03:16:24.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.265+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd86815f660 con 0x7fd8680aed50 2024-09-17T03:16:24.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.811+0000 7fd865600640 1 -- 172.21.15.153:0/3048239154 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7fd85406c020 con 0x7fd8680aed50 2024-09-17T03:16:24.810 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.813+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 msgr2=0x7fd84807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.813+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 0x7fd84807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd85c001a30 tx=0x7fd85c0015c0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.813+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 msgr2=0x7fd8680af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.813+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd85400f7f0 tx=0x7fd85400fcb0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 shutdown_connections 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd848078b90 0x7fd84807b0a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8680cff60 0x7fd8680d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8680aed50 0x7fd8680af160 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 --2- 172.21.15.153:0/3048239154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd850004d40 0x7fd8680aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:24.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 >> 172.21.15.153:0/3048239154 conn(0x7fd8680b1be0 msgr2=0x7fd8680b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:24.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 shutdown_connections 2024-09-17T03:16:24.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:24.814+0000 7fd86ec00640 1 -- 172.21.15.153:0/3048239154 wait complete. 2024-09-17T03:16:24.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:16:24.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-17T03:16:24.941 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-17T03:16:24.942 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-17T03:16:24.944 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:16:24.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-09-17T03:16:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:16:24.947 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:16:24.948 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:16:24.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: mon down mkfs grace = 300 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-17T03:16:24.950 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-17T03:16:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-17T03:16:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-09-17T03:16:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-09-17T03:16:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-09-17T03:16:24.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-17T03:16:24.952 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.953 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-17T03:16:24.954 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.153,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5a48c3a5-c841-4727-8f9d-e71702e4a9bd 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-17T03:16:24.955 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.956 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-09-17T03:16:24.957 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:16:24.958 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-17T03:16:24.959 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:16:24.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-17T03:16:24.961 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = "" 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2024-09-17T03:16:24.962 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-09-17T03:16:24.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 -- 172.21.15.153:0/214113851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00cdc40 msgr2=0x7f1fb0159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/214113851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00cdc40 0x7f1fb0159150 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0005fd0 tx=0x7f1fa002aa90 comp rx=0 tx=0).stop 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 -- 172.21.15.153:0/214113851 shutdown_connections 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/214113851 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb00705e0 0x7f1fb00709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/214113851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00cdc40 0x7f1fb0159150 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 -- 172.21.15.153:0/214113851 >> 172.21.15.153:0/214113851 conn(0x7f1fb00d0070 msgr2=0x7f1fb00d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 -- 172.21.15.153:0/214113851 shutdown_connections 2024-09-17T03:16:25.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.204+0000 7f1fb5a00640 1 -- 172.21.15.153:0/214113851 wait complete. 2024-09-17T03:16:25.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.207+0000 7f1fb5a00640 1 Processor -- start 2024-09-17T03:16:25.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.207+0000 7f1fb5a00640 1 -- start start 2024-09-17T03:16:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 0x7f1fb014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb015ba90 0x7f1fb014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00cf5f0 con 0x7f1fb00705e0 2024-09-17T03:16:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00cf470 con 0x7f1fb00cdc40 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.208+0000 7f1fb5a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb00cf770 con 0x7f1fb015ba90 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33860/0 (socket says 172.21.15.153:33860) 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 -- 172.21.15.153:0/1798823380 learned_addr learned my addr 172.21.15.153:0/1798823380 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faf400640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb015ba90 0x7f1fb014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1fa6000640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 0x7f1fb014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 -- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb015ba90 msgr2=0x7f1fb014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb015ba90 0x7f1fb014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 -- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 msgr2=0x7f1fb014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 0x7f1fb014f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 -- 172.21.15.153:0/1798823380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb015b3d0 con 0x7f1fb00705e0 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1fa6000640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 0x7f1fb014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:25.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.209+0000 7f1faea00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0000f80 tx=0x7f1fa0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:25.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.210+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0044070 con 0x7f1fb00705e0 2024-09-17T03:16:25.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.210+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fa0004250 con 0x7f1fb00705e0 2024-09-17T03:16:25.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.210+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0004660 con 0x7f1fb00705e0 2024-09-17T03:16:25.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.210+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb014d510 con 0x7f1fb00705e0 2024-09-17T03:16:25.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.210+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb014dad0 con 0x7f1fb00705e0 2024-09-17T03:16:25.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.211+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb00cfd00 con 0x7f1fb00705e0 2024-09-17T03:16:25.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.212+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fa0047070 con 0x7f1fb00705e0 2024-09-17T03:16:25.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.213+0000 7f1fa7400640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.214+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f1fa00bbc40 con 0x7f1fb00705e0 2024-09-17T03:16:25.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.214+0000 7f1fa6000640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.215+0000 7f1fa6000640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00aedd0 tx=0x7f1f98009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.218+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fa0032030 con 0x7f1fb00705e0 2024-09-17T03:16:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.408+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f1fb006dda0 con 0x7f1fb00705e0 2024-09-17T03:16:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.412+0000 7f1fa7400640 1 -- 172.21.15.153:0/1798823380 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f1fa0084190 con 0x7f1fb00705e0 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 msgr2=0x7f1f8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00aedd0 tx=0x7f1f98009040 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 msgr2=0x7f1fb0158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0000f80 tx=0x7f1fa0003ce0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 shutdown_connections 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1fb015ba90 0x7f1fb014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fb00cdc40 0x7f1fb014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 --2- 172.21.15.153:0/1798823380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb00705e0 0x7f1fb0158130 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 >> 172.21.15.153:0/1798823380 conn(0x7f1fb00d0070 msgr2=0x7f1fb015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.415+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 shutdown_connections 2024-09-17T03:16:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.416+0000 7f1fb5a00640 1 -- 172.21.15.153:0/1798823380 wait complete. 2024-09-17T03:16:25.440 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-09-17T03:16:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 -- 172.21.15.153:0/3093191693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f40ccfe0 msgr2=0x7fd3f41601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 --2- 172.21.15.153:0/3093191693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f40ccfe0 0x7fd3f41601a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009830 tx=0x7fd3dc02a530 comp rx=0 tx=0).stop 2024-09-17T03:16:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 -- 172.21.15.153:0/3093191693 shutdown_connections 2024-09-17T03:16:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 --2- 172.21.15.153:0/3093191693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f40ccfe0 0x7fd3f41601a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 -- 172.21.15.153:0/3093191693 >> 172.21.15.153:0/3093191693 conn(0x7fd3f40cf330 msgr2=0x7fd3f40d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 -- 172.21.15.153:0/3093191693 shutdown_connections 2024-09-17T03:16:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.666+0000 7fd3f3200640 1 -- 172.21.15.153:0/3093191693 wait complete. 2024-09-17T03:16:25.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.668+0000 7fd3f3200640 1 Processor -- start 2024-09-17T03:16:25.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.668+0000 7fd3f3200640 1 -- start start 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3f41606e0 0x7fd3f40c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3f414f8f0 0x7fd3f40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f4167b70 con 0x7fd3f4153720 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f4160cb0 con 0x7fd3f41606e0 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f3200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f4167cf0 con 0x7fd3f414f8f0 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33878/0 (socket says 172.21.15.153:33878) 2024-09-17T03:16:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 -- 172.21.15.153:0/1670407305 learned_addr learned my addr 172.21.15.153:0/1670407305 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3ebe00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3f41606e0 0x7fd3f40c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f2800640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3f414f8f0 0x7fd3f40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 -- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3f414f8f0 msgr2=0x7fd3f40c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3f414f8f0 0x7fd3f40c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 -- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3f41606e0 msgr2=0x7fd3f40c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3f41606e0 0x7fd3f40c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.670+0000 7fd3f1e00640 1 -- 172.21.15.153:0/1670407305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f415f980 con 0x7fd3f4153720 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3f1e00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400c390 tx=0x7fd3e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4017070 con 0x7fd3f4153720 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3e40035f0 con 0x7fd3f4153720 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f40cb950 con 0x7fd3f4153720 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4003a80 con 0x7fd3f4153720 2024-09-17T03:16:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.671+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f40c7b80 con 0x7fd3f4153720 2024-09-17T03:16:25.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.672+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f41601a0 con 0x7fd3f4153720 2024-09-17T03:16:25.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.673+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3e401a070 con 0x7fd3f4153720 2024-09-17T03:16:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.674+0000 7fd3ea000640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.675+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fd3e4099ee0 con 0x7fd3f4153720 2024-09-17T03:16:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.675+0000 7fd3ebe00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.676+0000 7fd3ebe00640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 0x7fd3d007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc034000 tx=0x7fd3dc004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:25.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.679+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3e4062430 con 0x7fd3f4153720 2024-09-17T03:16:25.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:25.937+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) -- 0x7fd3f40b3b30 con 0x7fd3f4153720 2024-09-17T03:16:26.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.828+0000 7fd3ea000640 1 -- 172.21.15.153:0/1670407305 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v173) ==== 143+0+0 (secure 0 0 0) 0x7fd3e4061d30 con 0x7fd3f4153720 2024-09-17T03:16:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 msgr2=0x7fd3d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 0x7fd3d007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc034000 tx=0x7fd3dc004730 comp rx=0 tx=0).stop 2024-09-17T03:16:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 msgr2=0x7fd3f414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400c390 tx=0x7fd3e4001e70 comp rx=0 tx=0).stop 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 shutdown_connections 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd3f414f8f0 0x7fd3f40c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3f41606e0 0x7fd3f40c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 --2- 172.21.15.153:0/1670407305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3f4153720 0x7fd3f414f280 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 >> 172.21.15.153:0/1670407305 conn(0x7fd3f40cf330 msgr2=0x7fd3f40cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 shutdown_connections 2024-09-17T03:16:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:26.831+0000 7fd3f3200640 1 -- 172.21.15.153:0/1670407305 wait complete. 2024-09-17T03:16:26.853 INFO:tasks.cephfs_test_runner:Opening a file should increment omap_total_updates by 1. ... ok 2024-09-17T03:16:26.853 INFO:tasks.cephfs_test_runner: 2024-09-17T03:16:26.854 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T03:16:26.854 INFO:tasks.cephfs_test_runner:Ran 2 tests in 131.306s 2024-09-17T03:16:26.854 INFO:tasks.cephfs_test_runner: 2024-09-17T03:16:26.854 INFO:tasks.cephfs_test_runner:OK 2024-09-17T03:16:26.854 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T03:16:26.862 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T03:16:26.887 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T03:16:26.887 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:26.887 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:26.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:16:26.924 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-17T03:16:26.924 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:27.000 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:16:27.000 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:16:27.000 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:27.040 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:16:27.041 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-17T03:16:27.041 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:16:27.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:16:27.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.119 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:16:27.154 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:16:27.154 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:16:27.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:16:27.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:16:27.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.502 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-17T03:16:27.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.789 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-17T03:16:27.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-17T03:16:27.927 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-17T03:16:27.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:27.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.930 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:16:27.970 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:16:27.970 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:16:27.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:27.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:16:28.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:28.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:16:28.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:28.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-09-17T03:16:28.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:28.641 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-09-17T03:16:28.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:16:28.677 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-09-17T03:16:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-09-17T03:16:28.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:28.779 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T03:16:28.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:16:28.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:16:29.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 -- 172.21.15.153:0/2294543087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc15f710 msgr2=0x7fbbbc151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2294543087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc15f710 0x7fbbbc151c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc072850 tx=0x7fbbb402aac0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 -- 172.21.15.153:0/2294543087 shutdown_connections 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2294543087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc15f710 0x7fbbbc151c40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2294543087 >> v2:172.21.15.164:3300/0 conn(0x7fbbbc0cbf40 0x7fbbbc0705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 -- 172.21.15.153:0/2294543087 >> 172.21.15.153:0/2294543087 conn(0x7fbbbc0d0070 msgr2=0x7fbbbc0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 -- 172.21.15.153:0/2294543087 shutdown_connections 2024-09-17T03:16:29.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.018+0000 7fbbc1600640 1 -- 172.21.15.153:0/2294543087 wait complete. 2024-09-17T03:16:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.020+0000 7fbbc1600640 1 Processor -- start 2024-09-17T03:16:29.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.021+0000 7fbbc1600640 1 -- start start 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbbc0cbf40 0x7fbbbc0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbbc15f710 0x7fbbbc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc152510 con 0x7fbbbc070b20 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc152390 con 0x7fbbbc15f710 2024-09-17T03:16:29.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbc1600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc152690 con 0x7fbbbc0cbf40 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbbaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbbaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33902/0 (socket says 172.21.15.153:33902) 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.022+0000 7fbbbaa00640 1 -- 172.21.15.153:0/2740629789 learned_addr learned my addr 172.21.15.153:0/2740629789 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbb2000640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbbc0cbf40 0x7fbbbc0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbb400640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbbc15f710 0x7fbbbc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 -- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbbc0cbf40 msgr2=0x7fbbbc0c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbbc0cbf40 0x7fbbbc0c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 -- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbbc15f710 msgr2=0x7fbbbc1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbbc15f710 0x7fbbbc1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 -- 172.21.15.153:0/2740629789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc0c4da0 con 0x7fbbbc070b20 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbbaa00640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00e7c0 tx=0x7fbbac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.023+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00ccc0 con 0x7fbbbc070b20 2024-09-17T03:16:29.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.024+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbac010430 con 0x7fbbbc070b20 2024-09-17T03:16:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.024+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc0c5080 con 0x7fbbbc070b20 2024-09-17T03:16:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.024+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac010860 con 0x7fbbbc070b20 2024-09-17T03:16:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.024+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc0c5640 con 0x7fbbbc070b20 2024-09-17T03:16:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.025+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbbc0705e0 con 0x7fbbbc070b20 2024-09-17T03:16:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.026+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbac010a00 con 0x7fbbbc070b20 2024-09-17T03:16:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.027+0000 7fbbb3400640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 0x7fbb9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.027+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fbbac09b590 con 0x7fbbbc070b20 2024-09-17T03:16:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.027+0000 7fbbb2000640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 0x7fbb9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.028+0000 7fbbb2000640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 0x7fbb9807b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0af2c0 tx=0x7fbba4009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.032+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbbac063490 con 0x7fbbbc070b20 2024-09-17T03:16:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.218+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbbc0b07b0 con 0x7fbb98078b90 2024-09-17T03:16:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.219+0000 7fbbb3400640 1 -- 172.21.15.153:0/2740629789 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7fbbbc0b07b0 con 0x7fbb98078b90 2024-09-17T03:16:29.218 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:29.218 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 msgr2=0x7fbb9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 0x7fbb9807b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0af2c0 tx=0x7fbba4009040 comp rx=0 tx=0).stop 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 msgr2=0x7fbbbc0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00e7c0 tx=0x7fbbac00ec80 comp rx=0 tx=0).stop 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 shutdown_connections 2024-09-17T03:16:29.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fbb98078b90 0x7fbb9807b0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbbbc15f710 0x7fbbbc1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbbbc0cbf40 0x7fbbbc0c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 --2- 172.21.15.153:0/2740629789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbbbc070b20 0x7fbbbc0cf000 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 >> 172.21.15.153:0/2740629789 conn(0x7fbbbc0d0070 msgr2=0x7fbbbc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 shutdown_connections 2024-09-17T03:16:29.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.221+0000 7fbbc1600640 1 -- 172.21.15.153:0/2740629789 wait complete. 2024-09-17T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-17T03:16:28.863798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236140,"kb_used_data":7416,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":7593984,"data_stored":4097619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7144,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-68,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.397678"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":188,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:16:24.964116+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:16:24.964116+0000","last_peered":"2024-09-17T03:16:24.964116+0000","last_clean":"2024-09-17T03:16:24.964116+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:16:24.964116+0000","last_undegraded":"2024-09-17T03:16:24.964116+0000","last_fullsized":"2024-09-17T03:16:24.964116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":359293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:16:29.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:16:29.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 -- 172.21.15.153:0/3870979147 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c0cbf40 msgr2=0x7fe16c0705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 --2- 172.21.15.153:0/3870979147 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c0cbf40 0x7fe16c0705e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe160009830 tx=0x7fe16002a510 comp rx=0 tx=0).stop 2024-09-17T03:16:29.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 -- 172.21.15.153:0/3870979147 shutdown_connections 2024-09-17T03:16:29.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 --2- 172.21.15.153:0/3870979147 >> v2:172.21.15.153:3300/0 conn(0x7fe16c15f710 0x7fe16c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 --2- 172.21.15.153:0/3870979147 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c0cbf40 0x7fe16c0705e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 -- 172.21.15.153:0/3870979147 >> 172.21.15.153:0/3870979147 conn(0x7fe16c0d0070 msgr2=0x7fe16c0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 -- 172.21.15.153:0/3870979147 shutdown_connections 2024-09-17T03:16:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.465+0000 7fe173400640 1 -- 172.21.15.153:0/3870979147 wait complete. 2024-09-17T03:16:29.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.467+0000 7fe173400640 1 Processor -- start 2024-09-17T03:16:29.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.467+0000 7fe173400640 1 -- start start 2024-09-17T03:16:29.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe16c0cbf40 0x7fe16c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c15f710 0x7fe16c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c152510 con 0x7fe16c070b20 2024-09-17T03:16:29.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c152390 con 0x7fe16c0cbf40 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe173400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c152690 con 0x7fe16c15f710 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33926/0 (socket says 172.21.15.153:33926) 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 -- 172.21.15.153:0/2722002839 learned_addr learned my addr 172.21.15.153:0/2722002839 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe16be00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe16c0cbf40 0x7fe16c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe171400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c15f710 0x7fe16c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 -- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c15f710 msgr2=0x7fe16c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c15f710 0x7fe16c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 -- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe16c0cbf40 msgr2=0x7fe16c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe16c0cbf40 0x7fe16c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.469+0000 7fe170a00640 1 -- 172.21.15.153:0/2722002839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c156300 con 0x7fe16c070b20 2024-09-17T03:16:29.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe170a00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe160000c00 tx=0x7fe160033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160005c90 con 0x7fe16c070b20 2024-09-17T03:16:29.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe160031e50 con 0x7fe16c070b20 2024-09-17T03:16:29.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c1565e0 con 0x7fe16c070b20 2024-09-17T03:16:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160033290 con 0x7fe16c070b20 2024-09-17T03:16:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.470+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c156ba0 con 0x7fe16c070b20 2024-09-17T03:16:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.471+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c0705e0 con 0x7fe16c070b20 2024-09-17T03:16:29.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.473+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe160033430 con 0x7fe16c070b20 2024-09-17T03:16:29.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.473+0000 7fe168c00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 0x7fe14c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.474+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fe1600bbf10 con 0x7fe16c070b20 2024-09-17T03:16:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.474+0000 7fe16be00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 0x7fe14c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.475+0000 7fe16be00640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 0x7fe14c07b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe16c158fb0 tx=0x7fe158009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.478+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe16003f030 con 0x7fe16c070b20 2024-09-17T03:16:29.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.656+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe16c0b1120 con 0x7fe14c078bc0 2024-09-17T03:16:29.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.657+0000 7fe168c00640 1 -- 172.21.15.153:0/2722002839 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7fe16c0b1120 con 0x7fe14c078bc0 2024-09-17T03:16:29.656 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:29.657 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.659+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 msgr2=0x7fe14c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.659+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 0x7fe14c07b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe16c158fb0 tx=0x7fe158009040 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.659+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 msgr2=0x7fe16c0b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.659+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe160000c00 tx=0x7fe160033c20 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 shutdown_connections 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fe14c078bc0 0x7fe14c07b0d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe16c15f710 0x7fe16c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe16c0cbf40 0x7fe16c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 --2- 172.21.15.153:0/2722002839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe16c070b20 0x7fe16c0b58d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 >> 172.21.15.153:0/2722002839 conn(0x7fe16c0d0070 msgr2=0x7fe16c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 shutdown_connections 2024-09-17T03:16:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.660+0000 7fe173400640 1 -- 172.21.15.153:0/2722002839 wait complete. 2024-09-17T03:16:29.685 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-17T03:16:28.863798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236140,"kb_used_data":7416,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":7593984,"data_stored":4097619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7144,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-68,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.397678"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":188,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:16:24.964116+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:16:24.964116+0000","last_peered":"2024-09-17T03:16:24.964116+0000","last_clean":"2024-09-17T03:16:24.964116+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:16:24.964116+0000","last_undegraded":"2024-09-17T03:16:24.964116+0000","last_fullsized":"2024-09-17T03:16:24.964116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":359293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:16:29.685 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:16:29.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 -- 172.21.15.153:0/1835761613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 msgr2=0x7f94e4073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 --2- 172.21.15.153:0/1835761613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e4073e20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f94e40cac10 tx=0x7f94d802a530 comp rx=0 tx=0).stop 2024-09-17T03:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 -- 172.21.15.153:0/1835761613 shutdown_connections 2024-09-17T03:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 --2- 172.21.15.153:0/1835761613 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e40749c0 0x7f94e406ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 --2- 172.21.15.153:0/1835761613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e4073e20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.907+0000 7f94eb800640 1 -- 172.21.15.153:0/1835761613 >> 172.21.15.153:0/1835761613 conn(0x7f94e40d0070 msgr2=0x7f94e40d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.908+0000 7f94eb800640 1 -- 172.21.15.153:0/1835761613 shutdown_connections 2024-09-17T03:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.908+0000 7f94eb800640 1 -- 172.21.15.153:0/1835761613 wait complete. 2024-09-17T03:16:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.910+0000 7f94eb800640 1 Processor -- start 2024-09-17T03:16:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.910+0000 7f94eb800640 1 -- start start 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e406f180 0x7f94e41f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94e40749c0 0x7f94e409ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41609c0 con 0x7f94e415c790 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4160840 con 0x7f94e40749c0 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.911+0000 7f94eb800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f94e4160b40 con 0x7f94e406f180 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e8e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e406f180 0x7f94e41f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33938/0 (socket says 172.21.15.153:33938) 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 -- 172.21.15.153:0/1187404396 learned_addr learned my addr 172.21.15.153:0/1187404396 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e3e00640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94e40749c0 0x7f94e409ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 -- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e406f180 msgr2=0x7f94e41f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e406f180 0x7f94e41f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 -- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94e40749c0 msgr2=0x7f94e409ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94e40749c0 0x7f94e409ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 -- 172.21.15.153:0/1187404396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e4153fd0 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.912+0000 7f94e9800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c6b0 tx=0x7f94dc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.913+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc003b70 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.913+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94dc003d10 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.913+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc005330 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.913+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e41f8ec0 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.913+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e41f9460 con 0x7f94e415c790 2024-09-17T03:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.914+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e406ec40 con 0x7f94e415c790 2024-09-17T03:16:29.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.915+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94dc0054d0 con 0x7f94e415c790 2024-09-17T03:16:29.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.917+0000 7f94e0c00640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 0x7f94c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:29.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.917+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f94dc09a8f0 con 0x7f94e415c790 2024-09-17T03:16:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.917+0000 7f94e8e00640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 0x7f94c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.918+0000 7f94e8e00640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 0x7f94c407b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94d8033000 tx=0x7f94d8004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:29.921+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f94e4153fd0 con 0x7f94e415c790 2024-09-17T03:16:30.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.101+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94e40cd4f0 con 0x7f94c4078b90 2024-09-17T03:16:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.103+0000 7f94e0c00640 1 -- 172.21.15.153:0/1187404396 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7f94e40cd4f0 con 0x7f94c4078b90 2024-09-17T03:16:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 msgr2=0x7f94c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 0x7f94c407b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94d8033000 tx=0x7f94d8004730 comp rx=0 tx=0).stop 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 msgr2=0x7f94e40c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c6b0 tx=0x7f94dc00cb70 comp rx=0 tx=0).stop 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 shutdown_connections 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f94c4078b90 0x7f94c407b0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94e415c790 0x7f94e40c9a20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f94e40749c0 0x7f94e409ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 --2- 172.21.15.153:0/1187404396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94e406f180 0x7f94e41f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.105+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 >> 172.21.15.153:0/1187404396 conn(0x7f94e40d0070 msgr2=0x7f94e4073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.106+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 shutdown_connections 2024-09-17T03:16:30.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.106+0000 7f94eb800640 1 -- 172.21.15.153:0/1187404396 wait complete. 2024-09-17T03:16:30.131 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-17T03:16:28.863798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236140,"kb_used_data":7416,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738580,"statfs":{"total":773094113280,"available":772852305920,"internally_reserved":0,"allocated":7593984,"data_stored":4097619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7144,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-68,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.397678"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":188,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:16:24.964116+0000","last_change":"2024-09-17T03:13:24.789706+0000","last_active":"2024-09-17T03:16:24.964116+0000","last_peered":"2024-09-17T03:16:24.964116+0000","last_clean":"2024-09-17T03:16:24.964116+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:16:24.964116+0000","last_undegraded":"2024-09-17T03:16:24.964116+0000","last_fullsized":"2024-09-17T03:16:24.964116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:23.771792+0000","last_clean_scrub_stamp":"2024-09-17T03:13:23.771792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:49.349790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":359293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:16:30.131 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:16:30.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 -- 172.21.15.153:0/2276248898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb288072dd0 msgr2=0x7fb28815bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 --2- 172.21.15.153:0/2276248898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb288072dd0 0x7fb28815bb40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb288072950 tx=0x7fb28002a9e0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 -- 172.21.15.153:0/2276248898 shutdown_connections 2024-09-17T03:16:30.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 --2- 172.21.15.153:0/2276248898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb288072dd0 0x7fb28815bb40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 --2- 172.21.15.153:0/2276248898 >> v2:172.21.15.164:3300/0 conn(0x7fb2880cbe90 0x7fb2880ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 -- 172.21.15.153:0/2276248898 >> 172.21.15.153:0/2276248898 conn(0x7fb2880b19c0 msgr2=0x7fb2880b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 -- 172.21.15.153:0/2276248898 shutdown_connections 2024-09-17T03:16:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.354+0000 7fb28d400640 1 -- 172.21.15.153:0/2276248898 wait complete. 2024-09-17T03:16:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.356+0000 7fb28d400640 1 Processor -- start 2024-09-17T03:16:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.356+0000 7fb28d400640 1 -- start start 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb288072dd0 0x7fb2880b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cbe90 0x7fb28815ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb28815c200 con 0x7fb2880729c0 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb28815c080 con 0x7fb2880cbe90 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28d400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb28815c380 con 0x7fb288072dd0 2024-09-17T03:16:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:30.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33956/0 (socket says 172.21.15.153:33956) 2024-09-17T03:16:30.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 -- 172.21.15.153:0/335935918 learned_addr learned my addr 172.21.15.153:0/335935918 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:30.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb27f400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb288072dd0 0x7fb2880b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:30.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb28ca00640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cbe90 0x7fb28815ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 -- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb288072dd0 msgr2=0x7fb2880b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb288072dd0 0x7fb2880b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 -- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cbe90 msgr2=0x7fb28815ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.358+0000 7fb287e00640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cbe90 0x7fb28815ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb287e00640 1 -- 172.21.15.153:0/335935918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb288151130 con 0x7fb2880729c0 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb287e00640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb27800d700 tx=0x7fb27800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278017070 con 0x7fb2880729c0 2024-09-17T03:16:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb278005310 con 0x7fb2880729c0 2024-09-17T03:16:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2780097c0 con 0x7fb2880729c0 2024-09-17T03:16:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2881505b0 con 0x7fb2880729c0 2024-09-17T03:16:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.359+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb288150b70 con 0x7fb2880729c0 2024-09-17T03:16:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.360+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28815bb40 con 0x7fb2880729c0 2024-09-17T03:16:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.361+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb278009960 con 0x7fb2880729c0 2024-09-17T03:16:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.363+0000 7fb284c00640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 0x7fb26407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.363+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fb27809acd0 con 0x7fb2880729c0 2024-09-17T03:16:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.363+0000 7fb27f400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 0x7fb26407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:30.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.364+0000 7fb27f400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 0x7fb26407b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb28809be80 tx=0x7fb270009060 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:30.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.368+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb278062b40 con 0x7fb2880729c0 2024-09-17T03:16:30.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.552+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb288160c00 con 0x7fb2880729c0 2024-09-17T03:16:30.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.553+0000 7fb284c00640 1 -- 172.21.15.153:0/335935918 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13475 (secure 0 0 0) 0x7fb278067570 con 0x7fb2880729c0 2024-09-17T03:16:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:30.552 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":67,"fsid":"5a48c3a5-c841-4727-8f9d-e71702e4a9bd","created":"2024-09-17T03:13:05.655289+0000","modified":"2024-09-17T03:16:24.810254+0000","last_up_change":"2024-09-17T03:13:21.449610+0000","last_in_change":"2024-09-17T03:13:11.401950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:13:22.848530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47dd9710-4d40-47dc-9abb-ead02c09be00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6825","nonce":86413606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6827","nonce":86413606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6831","nonce":86413606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":86413606},{"type":"v1","addr":"172.21.15.153:6829","nonce":86413606}]},"public_addr":"172.21.15.153:6825/86413606","cluster_addr":"172.21.15.153:6827/86413606","heartbeat_back_addr":"172.21.15.153:6831/86413606","heartbeat_front_addr":"172.21.15.153:6829/86413606","state":["exists","up"]},{"osd":1,"uuid":"cf8012e5-5da1-44b4-8711-836bcce71f1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6817","nonce":987187311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6819","nonce":987187311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6823","nonce":987187311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":987187311},{"type":"v1","addr":"172.21.15.153:6821","nonce":987187311}]},"public_addr":"172.21.15.153:6817/987187311","cluster_addr":"172.21.15.153:6819/987187311","heartbeat_back_addr":"172.21.15.153:6823/987187311","heartbeat_front_addr":"172.21.15.153:6821/987187311","state":["exists","up"]},{"osd":2,"uuid":"2ab5aef1-e1bf-455e-ae05-2198296e3f94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6801","nonce":1315287280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6803","nonce":1315287280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6807","nonce":1315287280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1315287280},{"type":"v1","addr":"172.21.15.153:6805","nonce":1315287280}]},"public_addr":"172.21.15.153:6801/1315287280","cluster_addr":"172.21.15.153:6803/1315287280","heartbeat_back_addr":"172.21.15.153:6807/1315287280","heartbeat_front_addr":"172.21.15.153:6805/1315287280","state":["exists","up"]},{"osd":3,"uuid":"44103905-4c48-4f5e-9e09-a9822c02d7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6809","nonce":4242955698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6811","nonce":4242955698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6815","nonce":4242955698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4242955698},{"type":"v1","addr":"172.21.15.153:6813","nonce":4242955698}]},"public_addr":"172.21.15.153:6809/4242955698","cluster_addr":"172.21.15.153:6811/4242955698","heartbeat_back_addr":"172.21.15.153:6815/4242955698","heartbeat_front_addr":"172.21.15.153:6813/4242955698","state":["exists","up"]},{"osd":4,"uuid":"2c785618-b3cc-4716-baaf-2785fb0bcbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6811","nonce":4054245927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6813","nonce":4054245927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6817","nonce":4054245927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":4054245927},{"type":"v1","addr":"172.21.15.164:6815","nonce":4054245927}]},"public_addr":"172.21.15.164:6811/4054245927","cluster_addr":"172.21.15.164:6813/4054245927","heartbeat_back_addr":"172.21.15.164:6817/4054245927","heartbeat_front_addr":"172.21.15.164:6815/4054245927","state":["exists","up"]},{"osd":5,"uuid":"fe974c58-81a1-4b15-9a83-38770a81151c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6827","nonce":2605220404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6829","nonce":2605220404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6833","nonce":2605220404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":2605220404},{"type":"v1","addr":"172.21.15.164:6831","nonce":2605220404}]},"public_addr":"172.21.15.164:6827/2605220404","cluster_addr":"172.21.15.164:6829/2605220404","heartbeat_back_addr":"172.21.15.164:6833/2605220404","heartbeat_front_addr":"172.21.15.164:6831/2605220404","state":["exists","up"]},{"osd":6,"uuid":"f644f925-1568-4cc3-8358-9be1f4b5b8c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6803","nonce":3366340382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6805","nonce":3366340382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6809","nonce":3366340382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3366340382},{"type":"v1","addr":"172.21.15.164:6807","nonce":3366340382}]},"public_addr":"172.21.15.164:6803/3366340382","cluster_addr":"172.21.15.164:6805/3366340382","heartbeat_back_addr":"172.21.15.164:6809/3366340382","heartbeat_front_addr":"172.21.15.164:6807/3366340382","state":["exists","up"]},{"osd":7,"uuid":"70710980-e8cc-475e-8c6b-1be89b4dd4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6819","nonce":1373012278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6821","nonce":1373012278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6825","nonce":1373012278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1373012278},{"type":"v1","addr":"172.21.15.164:6823","nonce":1373012278}]},"public_addr":"172.21.15.164:6819/1373012278","cluster_addr":"172.21.15.164:6821/1373012278","heartbeat_back_addr":"172.21.15.164:6825/1373012278","heartbeat_front_addr":"172.21.15.164:6823/1373012278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.494029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.679336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.818592+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.062252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.050907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.262519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:17.474332+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:13:18.226570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6836/1937223305":"2024-09-18T03:16:21.459958+0000","172.21.15.164:6834/1937223305":"2024-09-18T03:16:21.459958+0000","172.21.15.153:6834/1746730417":"2024-09-18T03:15:57.669030+0000","172.21.15.153:6832/1746730417":"2024-09-18T03:15:57.669030+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:16:30.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 msgr2=0x7fb26407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 0x7fb26407b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb28809be80 tx=0x7fb270009060 comp rx=0 tx=0).stop 2024-09-17T03:16:30.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 msgr2=0x7fb2881f9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:30.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb27800d700 tx=0x7fb27800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 shutdown_connections 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb264078b90 0x7fb26407b0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2880cbe90 0x7fb28815ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb288072dd0 0x7fb2880b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 --2- 172.21.15.153:0/335935918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2880729c0 0x7fb2881f9220 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 >> 172.21.15.153:0/335935918 conn(0x7fb2880b19c0 msgr2=0x7fb2880b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 shutdown_connections 2024-09-17T03:16:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:30.555+0000 7fb28d400640 1 -- 172.21.15.153:0/335935918 wait complete. 2024-09-17T03:16:31.577 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T03:16:31.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 -- 172.21.15.153:0/3893896137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 msgr2=0x7fb10c15ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 --2- 172.21.15.153:0/3893896137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15ce90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8005fd0 tx=0x7fb0f802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 -- 172.21.15.153:0/3893896137 shutdown_connections 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 --2- 172.21.15.153:0/3893896137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15ce90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 --2- 172.21.15.153:0/3893896137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb10c0cecb0 0x7fb10c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 -- 172.21.15.153:0/3893896137 >> 172.21.15.153:0/3893896137 conn(0x7fb10c06cd90 msgr2=0x7fb10c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 -- 172.21.15.153:0/3893896137 shutdown_connections 2024-09-17T03:16:31.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.810+0000 7fb10be00640 1 -- 172.21.15.153:0/3893896137 wait complete. 2024-09-17T03:16:31.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.813+0000 7fb10be00640 1 Processor -- start 2024-09-17T03:16:31.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.813+0000 7fb10be00640 1 -- start start 2024-09-17T03:16:31.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb10c06ed60 0x7fb10c1f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:31.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb10c0cecb0 0x7fb10c1f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:31.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c074600 con 0x7fb10c15ca80 2024-09-17T03:16:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c074480 con 0x7fb10c06ed60 2024-09-17T03:16:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.814+0000 7fb10be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c074780 con 0x7fb10c0cecb0 2024-09-17T03:16:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:31.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33966/0 (socket says 172.21.15.153:33966) 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 -- 172.21.15.153:0/3624735609 learned_addr learned my addr 172.21.15.153:0/3624735609 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10a000640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb10c0cecb0 0x7fb10c1f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10aa00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb10c06ed60 0x7fb10c1f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 -- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb10c0cecb0 msgr2=0x7fb10c1f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb10c0cecb0 0x7fb10c1f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 -- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb10c06ed60 msgr2=0x7fb10c1f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb10c06ed60 0x7fb10c1f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1f79f0 con 0x7fb10c15ca80 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10aa00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb10c06ed60 0x7fb10c1f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.815+0000 7fb10b400640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15b290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c730 tx=0x7fb10400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.816+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104003b70 con 0x7fb10c15ca80 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.816+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb104003d10 con 0x7fb10c15ca80 2024-09-17T03:16:31.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.816+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104005330 con 0x7fb10c15ca80 2024-09-17T03:16:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.816+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1f3b30 con 0x7fb10c15ca80 2024-09-17T03:16:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.816+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1f40f0 con 0x7fb10c15ca80 2024-09-17T03:16:31.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.817+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb10c074ca0 con 0x7fb10c15ca80 2024-09-17T03:16:31.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.818+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1040054d0 con 0x7fb10c15ca80 2024-09-17T03:16:31.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.819+0000 7fb102a00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0ec078bc0 0x7fb0ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:31.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.819+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fb10409b450 con 0x7fb10c15ca80 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.819+0000 7fb102a00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fb0ec07f150 0x7fb0ec0815e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb104018e70 con 0x7fb0ec07f150 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fb10409b800 con 0x7fb10c15ca80 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb10aa00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0ec078bc0 0x7fb0ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb10a000640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fb0ec07f150 0x7fb0ec0815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb10aa00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0ec078bc0 0x7fb0ec07b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009aa0 tx=0x7fb0fc005db0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.820+0000 7fb10a000640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fb0ec07f150 0x7fb0ec0815e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:31.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.821+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== osd.0 v2:172.21.15.153:6824/86413606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb104018e70 con 0x7fb0ec07f150 2024-09-17T03:16:31.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.834+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 --> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb10c1f38e0 con 0x7fb0ec07f150 2024-09-17T03:16:31.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb102a00640 1 -- 172.21.15.153:0/3624735609 <== osd.0 v2:172.21.15.153:6824/86413606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb10c1f38e0 con 0x7fb0ec07f150 2024-09-17T03:16:31.835 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:31.835 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:31.835 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:31.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fb0ec07f150 msgr2=0x7fb0ec0815e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:6824/86413606,v1:172.21.15.153:6825/86413606] conn(0x7fb0ec07f150 0x7fb0ec0815e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0ec078bc0 msgr2=0x7fb0ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb0ec078bc0 0x7fb0ec07b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009aa0 tx=0x7fb0fc005db0 comp rx=0 tx=0).stop 2024-09-17T03:16:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 msgr2=0x7fb10c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 --2- 172.21.15.153:0/3624735609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb10c15ca80 0x7fb10c15b290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c730 tx=0x7fb10400cb30 comp rx=0 tx=0).stop 2024-09-17T03:16:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10b400640 1 -- 172.21.15.153:0/3624735609 reap_dead start 2024-09-17T03:16:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 shutdown_connections 2024-09-17T03:16:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 >> 172.21.15.153:0/3624735609 conn(0x7fb10c06cd90 msgr2=0x7fb10c0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.835+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 shutdown_connections 2024-09-17T03:16:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:31.836+0000 7fb10be00640 1 -- 172.21.15.153:0/3624735609 wait complete. 2024-09-17T03:16:31.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T03:16:32.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 -- 172.21.15.153:0/2034714367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d94070cf0 msgr2=0x7f2d9415f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 --2- 172.21.15.153:0/2034714367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d94070cf0 0x7f2d9415f000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009830 tx=0x7f2d7c02a500 comp rx=0 tx=0).stop 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 -- 172.21.15.153:0/2034714367 shutdown_connections 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 --2- 172.21.15.153:0/2034714367 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 0x7f2d94151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 --2- 172.21.15.153:0/2034714367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d94070cf0 0x7f2d9415f000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 -- 172.21.15.153:0/2034714367 >> 172.21.15.153:0/2034714367 conn(0x7f2d940d0070 msgr2=0x7f2d940d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 -- 172.21.15.153:0/2034714367 shutdown_connections 2024-09-17T03:16:32.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.083+0000 7f2d9b200640 1 -- 172.21.15.153:0/2034714367 wait complete. 2024-09-17T03:16:32.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.085+0000 7f2d9b200640 1 Processor -- start 2024-09-17T03:16:32.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.085+0000 7f2d9b200640 1 -- start start 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 0x7f2d94159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9415b450 0x7f2d94159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2d94152550 con 0x7f2d940cbf40 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d941523d0 con 0x7f2d9415b450 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d9b200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2d941526d0 con 0x7f2d9415f540 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d93e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d93e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33978/0 (socket says 172.21.15.153:33978) 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d93e00640 1 -- 172.21.15.153:0/1160155589 learned_addr learned my addr 172.21.15.153:0/1160155589 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d99200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9415b450 0x7f2d94159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.087+0000 7f2d8b400640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 0x7f2d94159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 -- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 msgr2=0x7f2d94159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 0x7f2d94159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 -- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9415b450 msgr2=0x7f2d94159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9415b450 0x7f2d94159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 -- 172.21.15.153:0/1160155589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d941583a0 con 0x7f2d940cbf40 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d93e00640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7a0 tx=0x7f2d8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d84017070 con 0x7f2d940cbf40 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d84005070 con 0x7f2d940cbf40 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d94157320 con 0x7f2d940cbf40 2024-09-17T03:16:32.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d840054a0 con 0x7f2d940cbf40 2024-09-17T03:16:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.088+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d941578c0 con 0x7f2d940cbf40 2024-09-17T03:16:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.089+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d940694e0 con 0x7f2d940cbf40 2024-09-17T03:16:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.091+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d8401a070 con 0x7f2d940cbf40 2024-09-17T03:16:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.091+0000 7f2d90c00640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.092+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f2d8409a340 con 0x7f2d940cbf40 2024-09-17T03:16:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.092+0000 7f2d8b400640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.093+0000 7f2d8b400640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 0x7f2d7007b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c034000 tx=0x7f2d7c004730 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.096+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d940694e0 con 0x7f2d940cbf40 2024-09-17T03:16:32.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.279+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2d94074cc0 con 0x7f2d70078bc0 2024-09-17T03:16:32.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.280+0000 7f2d90c00640 1 -- 172.21.15.153:0/1160155589 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d94074cc0 con 0x7f2d70078bc0 2024-09-17T03:16:32.279 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 msgr2=0x7f2d7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 0x7f2d7007b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c034000 tx=0x7f2d7c004730 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 msgr2=0x7f2d941ee350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7a0 tx=0x7f2d8400cc60 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 shutdown_connections 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d70078bc0 0x7f2d7007b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d9415b450 0x7f2d94159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d9415f540 0x7f2d94159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 --2- 172.21.15.153:0/1160155589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d940cbf40 0x7f2d941ee350 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 >> 172.21.15.153:0/1160155589 conn(0x7f2d940d0070 msgr2=0x7f2d9415d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:32.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 shutdown_connections 2024-09-17T03:16:32.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.282+0000 7f2d9b200640 1 -- 172.21.15.153:0/1160155589 wait complete. 2024-09-17T03:16:32.305 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T03:16:32.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 -- 172.21.15.153:0/2061242376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9440051c0 msgr2=0x7fc94400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 --2- 172.21.15.153:0/2061242376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9440051c0 0x7fc94400b9c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc958001e40 tx=0x7fc944005830 comp rx=0 tx=0).stop 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 -- 172.21.15.153:0/2061242376 shutdown_connections 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 --2- 172.21.15.153:0/2061242376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9440051c0 0x7fc94400b9c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 -- 172.21.15.153:0/2061242376 >> 172.21.15.153:0/2061242376 conn(0x7fc96006cd90 msgr2=0x7fc96006d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.534+0000 7fc95f200640 1 -- 172.21.15.153:0/2061242376 shutdown_connections 2024-09-17T03:16:32.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.535+0000 7fc95f200640 1 -- 172.21.15.153:0/2061242376 wait complete. 2024-09-17T03:16:32.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.537+0000 7fc95f200640 1 Processor -- start 2024-09-17T03:16:32.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.537+0000 7fc95f200640 1 -- start start 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9440051c0 0x7fc9601f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600ce940 0x7fc960149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 0x7fc96014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc96006f170 con 0x7fc9601529b0 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600b3cf0 con 0x7fc9440051c0 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc96006f2f0 con 0x7fc9600ce940 2024-09-17T03:16:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.538+0000 7fc95e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 0x7fc96014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 0x7fc96014f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34004/0 (socket says 172.21.15.153:34004) 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 -- 172.21.15.153:0/704111103 learned_addr learned my addr 172.21.15.153:0/704111103 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95de00640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9440051c0 0x7fc9601f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc955400640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600ce940 0x7fc960149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 -- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600ce940 msgr2=0x7fc960149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9600ce940 0x7fc960149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 -- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9440051c0 msgr2=0x7fc9601f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9440051c0 0x7fc9601f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc960152f50 con 0x7fc9601529b0 2024-09-17T03:16:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.539+0000 7fc95e800640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 0x7fc96014f100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc95802ad90 tx=0x7fc958001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.540+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958003d80 con 0x7fc9601529b0 2024-09-17T03:16:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.540+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9600cde60 con 0x7fc9601529b0 2024-09-17T03:16:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.540+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc958032420 con 0x7fc9601529b0 2024-09-17T03:16:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.540+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958032830 con 0x7fc9601529b0 2024-09-17T03:16:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.540+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9600ce420 con 0x7fc9601529b0 2024-09-17T03:16:32.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.541+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9600b3e70 con 0x7fc9601529b0 2024-09-17T03:16:32.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.542+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc95803d030 con 0x7fc9601529b0 2024-09-17T03:16:32.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc956a00640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc93c078b90 0x7fc93c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fc9580bae30 con 0x7fc9601529b0 2024-09-17T03:16:32.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc956a00640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7fc93c07f120 0x7fc93c0815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc958006290 con 0x7fc93c07f120 2024-09-17T03:16:32.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fc9580bb1e0 con 0x7fc9601529b0 2024-09-17T03:16:32.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc955400640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7fc93c07f120 0x7fc93c0815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.543+0000 7fc95de00640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc93c078b90 0x7fc93c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.544+0000 7fc955400640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7fc93c07f120 0x7fc93c0815b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.544+0000 7fc95de00640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc93c078b90 0x7fc93c07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc950009460 tx=0x7fc950005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.545+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== osd.1 v2:172.21.15.153:6816/987187311 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc958006290 con 0x7fc93c07f120 2024-09-17T03:16:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.558+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 --> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc96015e5c0 con 0x7fc93c07f120 2024-09-17T03:16:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.558+0000 7fc956a00640 1 -- 172.21.15.153:0/704111103 <== osd.1 v2:172.21.15.153:6816/987187311 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc96015e5c0 con 0x7fc93c07f120 2024-09-17T03:16:32.558 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:32.558 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:32.558 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.558+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7fc93c07f120 msgr2=0x7fc93c0815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.558+0000 7fc95f200640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:6816/987187311,v1:172.21.15.153:6817/987187311] conn(0x7fc93c07f120 0x7fc93c0815b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc93c078b90 msgr2=0x7fc93c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc93c078b90 0x7fc93c07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc950009460 tx=0x7fc950005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 msgr2=0x7fc96014f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 --2- 172.21.15.153:0/704111103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9601529b0 0x7fc96014f100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc95802ad90 tx=0x7fc958001b20 comp rx=0 tx=0).stop 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95e800640 1 -- 172.21.15.153:0/704111103 reap_dead start 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 shutdown_connections 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 >> 172.21.15.153:0/704111103 conn(0x7fc96006cd90 msgr2=0x7fc96015cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:32.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 shutdown_connections 2024-09-17T03:16:32.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.559+0000 7fc95f200640 1 -- 172.21.15.153:0/704111103 wait complete. 2024-09-17T03:16:32.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 -- 172.21.15.153:0/4195252395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80cf900 msgr2=0x7f11f80cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 --2- 172.21.15.153:0/4195252395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80cf900 0x7f11f80cfd10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005fd0 tx=0x7f11f002aa90 comp rx=0 tx=0).stop 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 -- 172.21.15.153:0/4195252395 shutdown_connections 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 --2- 172.21.15.153:0/4195252395 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80cf900 0x7f11f80cfd10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 --2- 172.21.15.153:0/4195252395 >> v2:172.21.15.164:3300/0 conn(0x7f11f80d14f0 0x7f11f80cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 -- 172.21.15.153:0/4195252395 >> 172.21.15.153:0/4195252395 conn(0x7f11f809d680 msgr2=0x7f11f80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 -- 172.21.15.153:0/4195252395 shutdown_connections 2024-09-17T03:16:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.803+0000 7f11fe400640 1 -- 172.21.15.153:0/4195252395 wait complete. 2024-09-17T03:16:32.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.806+0000 7f11fe400640 1 Processor -- start 2024-09-17T03:16:32.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.806+0000 7f11fe400640 1 -- start start 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80d1fc0 0x7f11f81df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 0x7f11f81e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80d0250 con 0x7f11f80cf900 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80d1d60 con 0x7f11f80b2d60 2024-09-17T03:16:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.807+0000 7f11fe400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f11f80d03d0 con 0x7f11f80d1fc0 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34008/0 (socket says 172.21.15.153:34008) 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 -- 172.21.15.153:0/3320430505 learned_addr learned my addr 172.21.15.153:0/3320430505 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11efe00640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80d1fc0 0x7f11f81df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fda00640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 0x7f11f81e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 -- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80d1fc0 msgr2=0x7f11f81df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80d1fc0 0x7f11f81df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 -- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 msgr2=0x7f11f81e88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 0x7f11f81e88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 -- 172.21.15.153:0/3320430505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f81df6a0 con 0x7f11f80cf900 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fda00640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 0x7f11f81e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.808+0000 7f11fd000640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3c0 tx=0x7f11e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.809+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8017070 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.809+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11e80053c0 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.809+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8003850 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.809+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f81deba0 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.809+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f81e80c0 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.810+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f80cfd10 con 0x7f11f80cf900 2024-09-17T03:16:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.811+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11e801a070 con 0x7f11f80cf900 2024-09-17T03:16:32.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.812+0000 7f11f5600640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 0x7f11d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:32.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.812+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f11e8099f40 con 0x7f11f80cf900 2024-09-17T03:16:32.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.812+0000 7f11efe00640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 0x7f11d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:32.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.813+0000 7f11efe00640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 0x7f11d407b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11f80b41a0 tx=0x7f11e0005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:32.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:32.817+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11e8061e50 con 0x7f11f80cf900 2024-09-17T03:16:33.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.004+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f11f80b4790 con 0x7f11d4078b90 2024-09-17T03:16:33.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.005+0000 7f11f5600640 1 -- 172.21.15.153:0/3320430505 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11f80b4790 con 0x7f11d4078b90 2024-09-17T03:16:33.004 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T03:16:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 msgr2=0x7f11d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 0x7f11d407b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11f80b41a0 tx=0x7f11e0005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 msgr2=0x7f11f81ddcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3c0 tx=0x7f11e800c880 comp rx=0 tx=0).stop 2024-09-17T03:16:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 shutdown_connections 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f11d4078b90 0x7f11d407b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11f80b2d60 0x7f11f81e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f11f80d1fc0 0x7f11f81df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 --2- 172.21.15.153:0/3320430505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11f80cf900 0x7f11f81ddcc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 >> 172.21.15.153:0/3320430505 conn(0x7f11f809d680 msgr2=0x7f11f81e3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 shutdown_connections 2024-09-17T03:16:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.008+0000 7f11fe400640 1 -- 172.21.15.153:0/3320430505 wait complete. 2024-09-17T03:16:33.031 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T03:16:33.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:33.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 -- 172.21.15.153:0/2122377223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c0b2130 msgr2=0x7f473c0737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 --2- 172.21.15.153:0/2122377223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c0b2130 0x7f473c0737b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4734005fd0 tx=0x7f473402aa90 comp rx=0 tx=0).stop 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 -- 172.21.15.153:0/2122377223 shutdown_connections 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 --2- 172.21.15.153:0/2122377223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c0b2130 0x7f473c0737b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 --2- 172.21.15.153:0/2122377223 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c145c50 0x7f473c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 -- 172.21.15.153:0/2122377223 >> 172.21.15.153:0/2122377223 conn(0x7f473c06cd90 msgr2=0x7f473c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 -- 172.21.15.153:0/2122377223 shutdown_connections 2024-09-17T03:16:33.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.256+0000 7f4744400640 1 -- 172.21.15.153:0/2122377223 wait complete. 2024-09-17T03:16:33.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.259+0000 7f4744400640 1 Processor -- start 2024-09-17T03:16:33.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.259+0000 7f4744400640 1 -- start start 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c0b2130 0x7f473c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0ceee0 0x7f473c1e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 0x7f473c1e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f473c073e70 con 0x7f473c145c50 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f473c073cf0 con 0x7f473c0ceee0 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4744400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f473c073ff0 con 0x7f473c0b2130 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4742400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 0x7f473c1e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4742400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 0x7f473c1e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34038/0 (socket says 172.21.15.153:34038) 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4742400640 1 -- 172.21.15.153:0/3978670571 learned_addr learned my addr 172.21.15.153:0/3978670571 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.260+0000 7f4741a00640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c0b2130 0x7f473c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4741000640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0ceee0 0x7f473c1e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 -- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c0b2130 msgr2=0x7f473c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f473c0b2130 0x7f473c15baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 -- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0ceee0 msgr2=0x7f473c1e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f473c0ceee0 0x7f473c1e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c144770 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4742400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 0x7f473c1e7440 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4734009bf0 tx=0x7f4734003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734044070 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4734003e00 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.261+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c15c030 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.262+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340044b0 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.262+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1441b0 con 0x7f473c145c50 2024-09-17T03:16:33.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.262+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f473c074530 con 0x7f473c145c50 2024-09-17T03:16:33.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.264+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4734047070 con 0x7f473c145c50 2024-09-17T03:16:33.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4739600640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f471c078b90 0x7f471c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f47340bc250 con 0x7f473c145c50 2024-09-17T03:16:33.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4739600640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f471c07f120 0x7f471c0815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f473404fea0 con 0x7f471c07f120 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f47340bc600 con 0x7f473c145c50 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4741a00640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f471c078b90 0x7f471c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.265+0000 7f4741000640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f471c07f120 0x7f471c0815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.266+0000 7f4741a00640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f471c078b90 0x7f471c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4730000f60 tx=0x7f4730009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.266+0000 7f4741000640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f471c07f120 0x7f471c0815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.267+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== osd.2 v2:172.21.15.153:6800/1315287280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f473404fea0 con 0x7f471c07f120 2024-09-17T03:16:33.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.282+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 --> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f473c0b0b80 con 0x7f471c07f120 2024-09-17T03:16:33.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.282+0000 7f4739600640 1 -- 172.21.15.153:0/3978670571 <== osd.2 v2:172.21.15.153:6800/1315287280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f473c0b0b80 con 0x7f471c07f120 2024-09-17T03:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f471c07f120 msgr2=0x7f471c0815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:6800/1315287280,v1:172.21.15.153:6801/1315287280] conn(0x7f471c07f120 0x7f471c0815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f471c078b90 msgr2=0x7f471c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f471c078b90 0x7f471c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4730000f60 tx=0x7f4730009040 comp rx=0 tx=0).stop 2024-09-17T03:16:33.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 msgr2=0x7f473c1e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 --2- 172.21.15.153:0/3978670571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f473c145c50 0x7f473c1e7440 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4734009bf0 tx=0x7f4734003c10 comp rx=0 tx=0).stop 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4742400640 1 -- 172.21.15.153:0/3978670571 reap_dead start 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 shutdown_connections 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 >> 172.21.15.153:0/3978670571 conn(0x7f473c06cd90 msgr2=0x7f473c0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 shutdown_connections 2024-09-17T03:16:33.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.283+0000 7f4744400640 1 -- 172.21.15.153:0/3978670571 wait complete. 2024-09-17T03:16:33.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T03:16:33.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 -- 172.21.15.153:0/2741171692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d50003aa0 msgr2=0x7f2d50003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 --2- 172.21.15.153:0/2741171692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d50003aa0 0x7f2d50003f10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009b50 tx=0x7f2d50005830 comp rx=0 tx=0).stop 2024-09-17T03:16:33.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d70c00640 1 -- 172.21.15.153:0/2741171692 reap_dead start 2024-09-17T03:16:33.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 -- 172.21.15.153:0/2741171692 shutdown_connections 2024-09-17T03:16:33.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 -- 172.21.15.153:0/2741171692 >> 172.21.15.153:0/2741171692 conn(0x7f2d6c0b19c0 msgr2=0x7f2d6c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 -- 172.21.15.153:0/2741171692 shutdown_connections 2024-09-17T03:16:33.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.527+0000 7f2d71600640 1 -- 172.21.15.153:0/2741171692 wait complete. 2024-09-17T03:16:33.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.529+0000 7f2d71600640 1 Processor -- start 2024-09-17T03:16:33.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.529+0000 7f2d71600640 1 -- start start 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d50003aa0 0x7f2d6c1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d6c0cf070 0x7f2d6c1f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c06f6e0 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c06f560 con 0x7f2d6c0cf070 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d71600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c06f860 con 0x7f2d50003aa0 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d70c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d70c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34042/0 (socket says 172.21.15.153:34042) 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d70c00640 1 -- 172.21.15.153:0/4229493031 learned_addr learned my addr 172.21.15.153:0/4229493031 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d63400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d6c0cf070 0x7f2d6c1f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.531+0000 7f2d6be00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d50003aa0 0x7f2d6c1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 -- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d50003aa0 msgr2=0x7f2d6c1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d50003aa0 0x7f2d6c1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 -- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d6c0cf070 msgr2=0x7f2d6c1f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d6c0cf070 0x7f2d6c1f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 -- 172.21.15.153:0/4229493031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c15f160 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d70c00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2d64001330 tx=0x7f2d6400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400c990 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d64018070 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011460 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c0ce3f0 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.532+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c15ee80 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.533+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c0b1180 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.535+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d64011600 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.535+0000 7f2d68c00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 0x7f2d4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.536+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f2d6409aff0 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.536+0000 7f2d6be00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 0x7f2d4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.537+0000 7f2d6be00640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 0x7f2d4807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009b50 tx=0x7f2d5c02d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.540+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d6c0b1180 con 0x7f2d6c0cdaa0 2024-09-17T03:16:33.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.727+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2d6c072dd0 con 0x7f2d48078b90 2024-09-17T03:16:33.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.728+0000 7f2d68c00640 1 -- 172.21.15.153:0/4229493031 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d6c072dd0 con 0x7f2d48078b90 2024-09-17T03:16:33.727 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T03:16:33.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 msgr2=0x7f2d4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 0x7f2d4807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009b50 tx=0x7f2d5c02d040 comp rx=0 tx=0).stop 2024-09-17T03:16:33.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 msgr2=0x7f2d6c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2d64001330 tx=0x7f2d6400ec70 comp rx=0 tx=0).stop 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 shutdown_connections 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2d48078b90 0x7f2d4807b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d6c0cdaa0 0x7f2d6c0cdeb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d6c0cf070 0x7f2d6c1f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 --2- 172.21.15.153:0/4229493031 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d50003aa0 0x7f2d6c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 >> 172.21.15.153:0/4229493031 conn(0x7f2d6c0b19c0 msgr2=0x7f2d6c0aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 shutdown_connections 2024-09-17T03:16:33.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.730+0000 7f2d71600640 1 -- 172.21.15.153:0/4229493031 wait complete. 2024-09-17T03:16:33.751 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T03:16:33.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.980+0000 7fb69ac00640 1 -- 172.21.15.153:0/747788245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6940cc960 msgr2=0x7fb6940ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.980+0000 7fb69ac00640 1 --2- 172.21.15.153:0/747788245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6940cc960 0x7fb6940ccd70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb680005fd0 tx=0x7fb68002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 -- 172.21.15.153:0/747788245 shutdown_connections 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 --2- 172.21.15.153:0/747788245 >> v2:172.21.15.164:3300/0 conn(0x7fb694073d60 0x7fb694074170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 --2- 172.21.15.153:0/747788245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb6940cc960 0x7fb6940ccd70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 -- 172.21.15.153:0/747788245 >> 172.21.15.153:0/747788245 conn(0x7fb69406cd90 msgr2=0x7fb69406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 -- 172.21.15.153:0/747788245 shutdown_connections 2024-09-17T03:16:33.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.981+0000 7fb69ac00640 1 -- 172.21.15.153:0/747788245 wait complete. 2024-09-17T03:16:33.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.983+0000 7fb69ac00640 1 Processor -- start 2024-09-17T03:16:33.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.983+0000 7fb69ac00640 1 -- start start 2024-09-17T03:16:33.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb694073d60 0x7fb6941f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940cc960 0x7fb6940b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 0x7fb6940b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb694074830 con 0x7fb6940d0750 2024-09-17T03:16:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940746b0 con 0x7fb6940cc960 2024-09-17T03:16:33.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69ac00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb6940749b0 con 0x7fb694073d60 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 0x7fb6940b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 0x7fb6940b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42082/0 (socket says 172.21.15.153:42082) 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 -- 172.21.15.153:0/2664662622 learned_addr learned my addr 172.21.15.153:0/2664662622 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb698e00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940cc960 0x7fb6940b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb699800640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb694073d60 0x7fb6941f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 -- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb694073d60 msgr2=0x7fb6941f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb694073d60 0x7fb6941f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 -- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940cc960 msgr2=0x7fb6940b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940cc960 0x7fb6940b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.985+0000 7fb69a200640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6940aefc0 con 0x7fb6940d0750 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb69a200640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 0x7fb6940b1d30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00ebf0 tx=0x7fb68c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003b70 con 0x7fb6940d0750 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb68c003d10 con 0x7fb6940d0750 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6940ada10 con 0x7fb6940d0750 2024-09-17T03:16:33.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004280 con 0x7fb6940d0750 2024-09-17T03:16:33.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.986+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6940adf90 con 0x7fb6940d0750 2024-09-17T03:16:33.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.987+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb694074e80 con 0x7fb6940d0750 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.988+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb68c004420 con 0x7fb6940d0750 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.989+0000 7fb691600640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb674078b90 0x7fb67407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.989+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fb68c09b880 con 0x7fb6940d0750 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.990+0000 7fb691600640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fb67407f120 0x7fb6740815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.990+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb68c013e50 con 0x7fb67407f120 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.990+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fb68c0a02a0 con 0x7fb6940d0750 2024-09-17T03:16:33.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.990+0000 7fb699800640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb674078b90 0x7fb67407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.990+0000 7fb698e00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fb67407f120 0x7fb6740815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.991+0000 7fb698e00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fb67407f120 0x7fb6740815b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.991+0000 7fb699800640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb674078b90 0x7fb67407b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb688001720 tx=0x7fb688009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:33.991+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== osd.3 v2:172.21.15.153:6808/4242955698 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb68c013e50 con 0x7fb67407f120 2024-09-17T03:16:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.004+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 --> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb6940aed50 con 0x7fb67407f120 2024-09-17T03:16:34.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb691600640 1 -- 172.21.15.153:0/2664662622 <== osd.3 v2:172.21.15.153:6808/4242955698 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb6940aed50 con 0x7fb67407f120 2024-09-17T03:16:34.004 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:34.004 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:34.004 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fb67407f120 msgr2=0x7fb6740815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:6808/4242955698,v1:172.21.15.153:6809/4242955698] conn(0x7fb67407f120 0x7fb6740815b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb674078b90 msgr2=0x7fb67407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fb674078b90 0x7fb67407b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb688001720 tx=0x7fb688009040 comp rx=0 tx=0).stop 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 msgr2=0x7fb6940b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 --2- 172.21.15.153:0/2664662622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6940d0750 0x7fb6940b1d30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00ebf0 tx=0x7fb68c00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69a200640 1 -- 172.21.15.153:0/2664662622 reap_dead start 2024-09-17T03:16:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 shutdown_connections 2024-09-17T03:16:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 >> 172.21.15.153:0/2664662622 conn(0x7fb69406cd90 msgr2=0x7fb6940cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 shutdown_connections 2024-09-17T03:16:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.005+0000 7fb69ac00640 1 -- 172.21.15.153:0/2664662622 wait complete. 2024-09-17T03:16:34.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T03:16:34.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 -- 172.21.15.153:0/3277893747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c15c790 msgr2=0x7f257c073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 --2- 172.21.15.153:0/3277893747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c15c790 0x7f257c073e20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f257c0cc6c0 tx=0x7f257002a560 comp rx=0 tx=0).stop 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 -- 172.21.15.153:0/3277893747 shutdown_connections 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 --2- 172.21.15.153:0/3277893747 >> v2:172.21.15.164:3300/0 conn(0x7f257c0749c0 0x7f257c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 --2- 172.21.15.153:0/3277893747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c15c790 0x7f257c073e20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 -- 172.21.15.153:0/3277893747 >> 172.21.15.153:0/3277893747 conn(0x7f257c0d0070 msgr2=0x7f257c0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 -- 172.21.15.153:0/3277893747 shutdown_connections 2024-09-17T03:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.248+0000 7f2583e00640 1 -- 172.21.15.153:0/3277893747 wait complete. 2024-09-17T03:16:34.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.251+0000 7f2583e00640 1 Processor -- start 2024-09-17T03:16:34.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.251+0000 7f2583e00640 1 -- start start 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f257c0749c0 0x7f257c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 0x7f257c09d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f257c1609c0 con 0x7f257c06f180 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f257c160840 con 0x7f257c0749c0 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2583e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f257c160b40 con 0x7f257c15c790 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.252+0000 7f2581400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42094/0 (socket says 172.21.15.153:42094) 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 -- 172.21.15.153:0/2672640521 learned_addr learned my addr 172.21.15.153:0/2672640521 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2580a00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f257c0749c0 0x7f257c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 0x7f257c09d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 -- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 msgr2=0x7f257c09d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 0x7f257c09d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 -- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f257c0749c0 msgr2=0x7f257c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f257c0749c0 0x7f257c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 -- 172.21.15.153:0/2672640521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c1f5cf0 con 0x7f257c06f180 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 0x7f257c09d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.253+0000 7f2581400640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2570034040 tx=0x7f2570003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.254+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257003e030 con 0x7f257c06f180 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.254+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2570003e00 con 0x7f257c06f180 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.254+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570035040 con 0x7f257c06f180 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.254+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c1f5fd0 con 0x7f257c06f180 2024-09-17T03:16:34.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.254+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c1f6590 con 0x7f257c06f180 2024-09-17T03:16:34.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.255+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257c06ec40 con 0x7f257c06f180 2024-09-17T03:16:34.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.256+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2570041030 con 0x7f257c06f180 2024-09-17T03:16:34.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.257+0000 7f2579600640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 0x7f255c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.257+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f25700bb460 con 0x7f257c06f180 2024-09-17T03:16:34.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.258+0000 7f2580a00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 0x7f255c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.258+0000 7f2580a00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 0x7f255c07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f257c072d50 tx=0x7f256800b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.261+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25700832d0 con 0x7f257c06f180 2024-09-17T03:16:34.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.446+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f257c0703a0 con 0x7f255c078b90 2024-09-17T03:16:34.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.447+0000 7f2579600640 1 -- 172.21.15.153:0/2672640521 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f257c0703a0 con 0x7f255c078b90 2024-09-17T03:16:34.446 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.449+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 msgr2=0x7f255c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.449+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 0x7f255c07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f257c072d50 tx=0x7f256800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.449+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 msgr2=0x7f257c1f9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.449+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2570034040 tx=0x7f2570003910 comp rx=0 tx=0).stop 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 shutdown_connections 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f255c078b90 0x7f255c07b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f257c15c790 0x7f257c09d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f257c0749c0 0x7f257c15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 --2- 172.21.15.153:0/2672640521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f257c06f180 0x7f257c1f9bb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 >> 172.21.15.153:0/2672640521 conn(0x7f257c0d0070 msgr2=0x7f257c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 shutdown_connections 2024-09-17T03:16:34.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.450+0000 7f2583e00640 1 -- 172.21.15.153:0/2672640521 wait complete. 2024-09-17T03:16:34.473 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T03:16:34.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 -- 172.21.15.153:0/498628501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f415e740 msgr2=0x7f91f4073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 --2- 172.21.15.153:0/498628501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f415e740 0x7f91f4073210 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f91e0005fd0 tx=0x7f91e002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 -- 172.21.15.153:0/498628501 shutdown_connections 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 --2- 172.21.15.153:0/498628501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 0x7f91f40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 --2- 172.21.15.153:0/498628501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f415e740 0x7f91f4073210 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.699+0000 7f91fac00640 1 -- 172.21.15.153:0/498628501 >> 172.21.15.153:0/498628501 conn(0x7f91f406cd90 msgr2=0x7f91f406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.700+0000 7f91fac00640 1 -- 172.21.15.153:0/498628501 shutdown_connections 2024-09-17T03:16:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.700+0000 7f91fac00640 1 -- 172.21.15.153:0/498628501 wait complete. 2024-09-17T03:16:34.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.702+0000 7f91fac00640 1 Processor -- start 2024-09-17T03:16:34.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.702+0000 7f91fac00640 1 -- start start 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 0x7f91f40b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 0x7f91f41f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91f415e740 0x7f91f4144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f40d0590 con 0x7f91f40af6b0 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f91f40b25a0 con 0x7f91f415e740 2024-09-17T03:16:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.703+0000 7f91fac00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f91f40d0710 con 0x7f91f4073750 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 0x7f91f41f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 0x7f91f41f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42102/0 (socket says 172.21.15.153:42102) 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 -- 172.21.15.153:0/2954303643 learned_addr learned my addr 172.21.15.153:0/2954303643 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f8c00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91f415e740 0x7f91f4144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 -- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 msgr2=0x7f91f40b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3e00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 0x7f91f40b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 0x7f91f40b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 -- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91f415e740 msgr2=0x7f91f4144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91f415e740 0x7f91f4144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41f6590 con 0x7f91f40af6b0 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f8c00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f91f415e740 0x7f91f4144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3e00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91f4073750 0x7f91f40b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.704+0000 7f91f3400640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 0x7f91f41f5830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f91e0034040 tx=0x7f91e00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.705+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e003e030 con 0x7f91f40af6b0 2024-09-17T03:16:34.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.705+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91e0003ca0 con 0x7f91f40af6b0 2024-09-17T03:16:34.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.705+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0035040 con 0x7f91f40af6b0 2024-09-17T03:16:34.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.705+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f4147840 con 0x7f91f40af6b0 2024-09-17T03:16:34.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.705+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f4147e00 con 0x7f91f40af6b0 2024-09-17T03:16:34.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.706+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91f40d0c30 con 0x7f91f40af6b0 2024-09-17T03:16:34.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.707+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91e0041030 con 0x7f91f40af6b0 2024-09-17T03:16:34.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.708+0000 7f91ebe00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f91d4078b90 0x7f91d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.708+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f91e00bb8f0 con 0x7f91f40af6b0 2024-09-17T03:16:34.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.708+0000 7f91ebe00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f91d407f120 0x7f91d40815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.708+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91e004de50 con 0x7f91d407f120 2024-09-17T03:16:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.708+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f91e00bbca0 con 0x7f91f40af6b0 2024-09-17T03:16:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.709+0000 7f91f3e00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f91d4078b90 0x7f91d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.709+0000 7f91f8c00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f91d407f120 0x7f91d40815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.709+0000 7f91f3e00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f91d4078b90 0x7f91d407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91e40016a0 tx=0x7f91e4009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.710+0000 7f91f8c00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f91d407f120 0x7f91d40815b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.711+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== osd.4 v2:172.21.15.164:6810/4054245927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91e004de50 con 0x7f91d407f120 2024-09-17T03:16:34.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.723+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 --> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f91f41f6340 con 0x7f91d407f120 2024-09-17T03:16:34.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.724+0000 7f91ebe00640 1 -- 172.21.15.153:0/2954303643 <== osd.4 v2:172.21.15.164:6810/4054245927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f91f41f6340 con 0x7f91d407f120 2024-09-17T03:16:34.723 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:34.723 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:34.724 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:34.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f91d407f120 msgr2=0x7f91d40815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6810/4054245927,v1:172.21.15.164:6811/4054245927] conn(0x7f91d407f120 0x7f91d40815b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f91d4078b90 msgr2=0x7f91d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f91d4078b90 0x7f91d407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91e40016a0 tx=0x7f91e4009040 comp rx=0 tx=0).stop 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 msgr2=0x7f91f41f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 --2- 172.21.15.153:0/2954303643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f40af6b0 0x7f91f41f5830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f91e0034040 tx=0x7f91e00038a0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91f8c00640 1 -- 172.21.15.153:0/2954303643 reap_dead start 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 shutdown_connections 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 >> 172.21.15.153:0/2954303643 conn(0x7f91f406cd90 msgr2=0x7f91f41580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 shutdown_connections 2024-09-17T03:16:34.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.725+0000 7f91fac00640 1 -- 172.21.15.153:0/2954303643 wait complete. 2024-09-17T03:16:34.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T03:16:34.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 -- 172.21.15.153:0/3364555618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2398003a70 msgr2=0x7f2398003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 --2- 172.21.15.153:0/3364555618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2398003a70 0x7f2398003f00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009b20 tx=0x7f2398005830 comp rx=0 tx=0).stop 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b6800640 1 -- 172.21.15.153:0/3364555618 reap_dead start 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 -- 172.21.15.153:0/3364555618 shutdown_connections 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 -- 172.21.15.153:0/3364555618 >> 172.21.15.153:0/3364555618 conn(0x7f23b00d0070 msgr2=0x7f23b00d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 -- 172.21.15.153:0/3364555618 shutdown_connections 2024-09-17T03:16:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.970+0000 7f23b8800640 1 -- 172.21.15.153:0/3364555618 wait complete. 2024-09-17T03:16:34.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.972+0000 7f23b8800640 1 Processor -- start 2024-09-17T03:16:34.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.973+0000 7f23b8800640 1 -- start start 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2398003a70 0x7f23b009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23b01f6fc0 0x7f23b014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23b006edc0 con 0x7f23b009da70 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23b006ec40 con 0x7f2398003a70 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b8800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f23b006ef40 con 0x7f23b01f6fc0 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42118/0 (socket says 172.21.15.153:42118) 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b5400640 1 -- 172.21.15.153:0/1010048740 learned_addr learned my addr 172.21.15.153:0/1010048740 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b5e00640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2398003a70 0x7f23b009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.974+0000 7f23b6800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23b01f6fc0 0x7f23b014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 -- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23b01f6fc0 msgr2=0x7f23b014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23b01f6fc0 0x7f23b014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 -- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2398003a70 msgr2=0x7f23b009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2398003a70 0x7f23b009aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 -- 172.21.15.153:0/1010048740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b009b2e0 con 0x7f23b009da70 2024-09-17T03:16:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23b5400640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f23a0011ab0 tx=0x7f23a0011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.975+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a001e070 con 0x7f23b009da70 2024-09-17T03:16:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.976+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0004460 con 0x7f23b009da70 2024-09-17T03:16:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.976+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b009b5c0 con 0x7f23b009da70 2024-09-17T03:16:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.976+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a000fc40 con 0x7f23b009da70 2024-09-17T03:16:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.976+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b009bb80 con 0x7f23b009da70 2024-09-17T03:16:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.977+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b00703e0 con 0x7f23b009da70 2024-09-17T03:16:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.978+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23a0021070 con 0x7f23b009da70 2024-09-17T03:16:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.979+0000 7f23aa000640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 0x7f239407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.979+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f23a009b6a0 con 0x7f23b009da70 2024-09-17T03:16:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.979+0000 7f23b5e00640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 0x7f239407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.980+0000 7f23b5e00640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 0x7f239407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23a4035000 tx=0x7f23a402d040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:34.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:34.983+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23b00703e0 con 0x7f23b009da70 2024-09-17T03:16:35.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.165+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f23b0073e20 con 0x7f2394078b90 2024-09-17T03:16:35.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.165+0000 7f23aa000640 1 -- 172.21.15.153:0/1010048740 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23b0073e20 con 0x7f2394078b90 2024-09-17T03:16:35.164 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T03:16:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 msgr2=0x7f239407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 0x7f239407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23a4035000 tx=0x7f23a402d040 comp rx=0 tx=0).stop 2024-09-17T03:16:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 msgr2=0x7f23b01f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f23a0011ab0 tx=0x7f23a0011f70 comp rx=0 tx=0).stop 2024-09-17T03:16:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 shutdown_connections 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f2394078b90 0x7f239407b0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23b01f6fc0 0x7f23b014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b009da70 0x7f23b01f6a80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 --2- 172.21.15.153:0/1010048740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2398003a70 0x7f23b009aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 >> 172.21.15.153:0/1010048740 conn(0x7f23b00d0070 msgr2=0x7f23b00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 shutdown_connections 2024-09-17T03:16:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.168+0000 7f23b8800640 1 -- 172.21.15.153:0/1010048740 wait complete. 2024-09-17T03:16:35.189 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T03:16:35.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 -- 172.21.15.153:0/3704029081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc40d0d10 msgr2=0x7f3bc4074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 --2- 172.21.15.153:0/3704029081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc40d0d10 0x7f3bc4074920 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009820 tx=0x7f3bb402a510 comp rx=0 tx=0).stop 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 -- 172.21.15.153:0/3704029081 shutdown_connections 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 --2- 172.21.15.153:0/3704029081 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc415cb50 0x7f3bc415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 --2- 172.21.15.153:0/3704029081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc40d0d10 0x7f3bc4074920 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 -- 172.21.15.153:0/3704029081 >> 172.21.15.153:0/3704029081 conn(0x7f3bc40d1140 msgr2=0x7f3bc40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 -- 172.21.15.153:0/3704029081 shutdown_connections 2024-09-17T03:16:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.415+0000 7f3bca200640 1 -- 172.21.15.153:0/3704029081 wait complete. 2024-09-17T03:16:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.417+0000 7f3bca200640 1 Processor -- start 2024-09-17T03:16:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.417+0000 7f3bca200640 1 -- start start 2024-09-17T03:16:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 0x7f3bc41e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc40d0d10 0x7f3bc40b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 0x7f3bc40b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40cdf20 con 0x7f3bc415cb50 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40cdda0 con 0x7f3bc406cd90 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bca200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc40ce0a0 con 0x7f3bc40d0d10 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bc3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 0x7f3bc40b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bc3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 0x7f3bc41e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bc3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 0x7f3bc41e83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.153:33520/0 (socket says 172.21.15.153:33520) 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bc3400640 1 -- 172.21.15.153:0/1936948361 learned_addr learned my addr 172.21.15.153:0/1936948361 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bc3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 0x7f3bc40b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42148/0 (socket says 172.21.15.153:42148) 2024-09-17T03:16:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.419+0000 7f3bbaa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc40d0d10 0x7f3bc40b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 -- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc40d0d10 msgr2=0x7f3bc40b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc40d0d10 0x7f3bc40b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 -- 172.21.15.153:0/1936948361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 msgr2=0x7f3bc40b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 0x7f3bc40b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc41e8910 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3e00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc415cb50 0x7f3bc40b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.420+0000 7f3bc3400640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 0x7f3bc41e83d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb402ab00 tx=0x7f3bb4004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.421+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb403f070 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.421+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bb4004e50 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.421+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc41f8ad0 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.421+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4031950 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.421+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc41f9090 con 0x7f3bc406cd90 2024-09-17T03:16:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.422+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bc40cf3b0 con 0x7f3bc406cd90 2024-09-17T03:16:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.424+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bb4042070 con 0x7f3bc406cd90 2024-09-17T03:16:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.424+0000 7f3bbbe00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3ba0078b90 0x7f3ba007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f3bb40bbf70 con 0x7f3bc406cd90 2024-09-17T03:16:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bbbe00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7f3ba007f120 0x7f3ba00815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bb4040e50 con 0x7f3ba007f120 2024-09-17T03:16:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f3bb40bc320 con 0x7f3bc406cd90 2024-09-17T03:16:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bbaa00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3ba0078b90 0x7f3ba007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.425+0000 7f3bc3e00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7f3ba007f120 0x7f3ba00815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.426+0000 7f3bbaa00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3ba0078b90 0x7f3ba007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40cebb0 tx=0x7f3bac00b2e0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:35.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.426+0000 7f3bc3e00640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7f3ba007f120 0x7f3ba00815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:35.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.427+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== osd.5 v2:172.21.15.164:6826/2605220404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bb4040e50 con 0x7f3ba007f120 2024-09-17T03:16:35.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.440+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 --> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3bc40ce550 con 0x7f3ba007f120 2024-09-17T03:16:35.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.440+0000 7f3bbbe00640 1 -- 172.21.15.153:0/1936948361 <== osd.5 v2:172.21.15.164:6826/2605220404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3bc40ce550 con 0x7f3ba007f120 2024-09-17T03:16:35.441 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:35.441 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:35.442 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7f3ba007f120 msgr2=0x7f3ba00815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6826/2605220404,v1:172.21.15.164:6827/2605220404] conn(0x7f3ba007f120 0x7f3ba00815b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3ba0078b90 msgr2=0x7f3ba007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f3ba0078b90 0x7f3ba007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40cebb0 tx=0x7f3bac00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 msgr2=0x7f3bc41e83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 --2- 172.21.15.153:0/1936948361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc406cd90 0x7f3bc41e83d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb402ab00 tx=0x7f3bb4004a50 comp rx=0 tx=0).stop 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bc3e00640 1 -- 172.21.15.153:0/1936948361 reap_dead start 2024-09-17T03:16:35.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 shutdown_connections 2024-09-17T03:16:35.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 >> 172.21.15.153:0/1936948361 conn(0x7f3bc40d1140 msgr2=0x7f3bc40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:35.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 shutdown_connections 2024-09-17T03:16:35.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.441+0000 7f3bca200640 1 -- 172.21.15.153:0/1936948361 wait complete. 2024-09-17T03:16:35.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T03:16:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 -- 172.21.15.153:0/2961182494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 msgr2=0x7f23c015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 --2- 172.21.15.153:0/2961182494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c015bb40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005fd0 tx=0x7f23b802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 -- 172.21.15.153:0/2961182494 shutdown_connections 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 --2- 172.21.15.153:0/2961182494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c015bb40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 --2- 172.21.15.153:0/2961182494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 0x7f23c00ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 -- 172.21.15.153:0/2961182494 >> 172.21.15.153:0/2961182494 conn(0x7f23c00b19c0 msgr2=0x7f23c00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 -- 172.21.15.153:0/2961182494 shutdown_connections 2024-09-17T03:16:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.685+0000 7f23c6c00640 1 -- 172.21.15.153:0/2961182494 wait complete. 2024-09-17T03:16:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.687+0000 7f23c6c00640 1 Processor -- start 2024-09-17T03:16:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.688+0000 7f23c6c00640 1 -- start start 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c00729c0 0x7f23c01f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 0x7f23c015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015c410 con 0x7f23c0072dd0 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015c290 con 0x7f23c00729c0 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c6c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f23c015c590 con 0x7f23c00cbe90 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42160/0 (socket says 172.21.15.153:42160) 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.689+0000 7f23c4e00640 1 -- 172.21.15.153:0/408765102 learned_addr learned my addr 172.21.15.153:0/408765102 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c6200640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 0x7f23c015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c5800640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c00729c0 0x7f23c01f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 -- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 msgr2=0x7f23c015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 0x7f23c015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 -- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c00729c0 msgr2=0x7f23c01f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c00729c0 0x7f23c01f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 -- 172.21.15.153:0/408765102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c00cfa40 con 0x7f23c0072dd0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c4e00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c3a0 tx=0x7f23ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011790 con 0x7f23c0072dd0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23ac017070 con 0x7f23c0072dd0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c015b480 con 0x7f23c0072dd0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.690+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011cc0 con 0x7f23c0072dd0 2024-09-17T03:16:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.691+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c00c98c0 con 0x7f23c0072dd0 2024-09-17T03:16:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.692+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c015bb40 con 0x7f23c0072dd0 2024-09-17T03:16:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.693+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23ac01c460 con 0x7f23c0072dd0 2024-09-17T03:16:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.694+0000 7f23bd600640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 0x7f23a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.694+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f23ac09a960 con 0x7f23c0072dd0 2024-09-17T03:16:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.694+0000 7f23c5800640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 0x7f23a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:35.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.695+0000 7f23c5800640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 0x7f23a007b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009b30 tx=0x7f23b4005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:35.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.698+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23ac062860 con 0x7f23c0072dd0 2024-09-17T03:16:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.882+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f23c015fcd0 con 0x7f23a0078b90 2024-09-17T03:16:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.883+0000 7f23bd600640 1 -- 172.21.15.153:0/408765102 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23c015fcd0 con 0x7f23a0078b90 2024-09-17T03:16:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T03:16:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 msgr2=0x7f23a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 0x7f23a007b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009b30 tx=0x7f23b4005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 msgr2=0x7f23c00cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c3a0 tx=0x7f23ac00c860 comp rx=0 tx=0).stop 2024-09-17T03:16:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 shutdown_connections 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f23a0078b90 0x7f23a007b0a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23c00cbe90 0x7f23c015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c0072dd0 0x7f23c00cf500 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 --2- 172.21.15.153:0/408765102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23c00729c0 0x7f23c01f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 >> 172.21.15.153:0/408765102 conn(0x7f23c00b19c0 msgr2=0x7f23c006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 shutdown_connections 2024-09-17T03:16:35.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:35.886+0000 7f23c6c00640 1 -- 172.21.15.153:0/408765102 wait complete. 2024-09-17T03:16:35.909 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T03:16:35.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 -- 172.21.15.153:0/1616661863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae600cd070 msgr2=0x7fae60073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 --2- 172.21.15.153:0/1616661863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae600cd070 0x7fae60073d60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fae600d0f90 tx=0x7fae5802aac0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 -- 172.21.15.153:0/1616661863 shutdown_connections 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 --2- 172.21.15.153:0/1616661863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae600cd070 0x7fae60073d60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 --2- 172.21.15.153:0/1616661863 >> v2:172.21.15.164:3300/0 conn(0x7fae600d0750 0x7fae6015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 -- 172.21.15.153:0/1616661863 >> 172.21.15.153:0/1616661863 conn(0x7fae6006cd90 msgr2=0x7fae6006d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 -- 172.21.15.153:0/1616661863 shutdown_connections 2024-09-17T03:16:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.134+0000 7fae66c00640 1 -- 172.21.15.153:0/1616661863 wait complete. 2024-09-17T03:16:36.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.136+0000 7fae66c00640 1 Processor -- start 2024-09-17T03:16:36.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.137+0000 7fae66c00640 1 -- start start 2024-09-17T03:16:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae600d0750 0x7fae6015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 0x7fae6015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae60146280 0x7fae600cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae60074670 con 0x7fae6015cf50 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fae600744f0 con 0x7fae60146280 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fae600747f0 con 0x7fae600d0750 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae64e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 0x7fae6015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae64e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 0x7fae6015f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42188/0 (socket says 172.21.15.153:42188) 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae64e00640 1 -- 172.21.15.153:0/775943873 learned_addr learned my addr 172.21.15.153:0/775943873 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae66200640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae60146280 0x7fae600cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.138+0000 7fae65800640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae600d0750 0x7fae6015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 -- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae600d0750 msgr2=0x7fae6015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae600d0750 0x7fae6015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 -- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae60146280 msgr2=0x7fae600cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae60146280 0x7fae600cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae601f6480 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae64e00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 0x7fae6015f4d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c3c0 tx=0x7fae4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c017070 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c0053c0 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae601f6760 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.139+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c003850 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.140+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae601f6d20 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.141+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae601f2b40 con 0x7fae6015cf50 2024-09-17T03:16:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.142+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae4c01a070 con 0x7fae6015cf50 2024-09-17T03:16:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae5d600640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fae4c099f80 con 0x7fae6015cf50 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae5d600640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7fae4007f120 0x7fae400815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae4c016ec0 con 0x7fae4007f120 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fae4c09c5a0 con 0x7fae6015cf50 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae65800640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.143+0000 7fae66200640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7fae4007f120 0x7fae400815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.144+0000 7fae65800640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fae54009b30 tx=0x7fae54005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.144+0000 7fae66200640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7fae4007f120 0x7fae400815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.145+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== osd.6 v2:172.21.15.164:6802/3366340382 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae4c016ec0 con 0x7fae4007f120 2024-09-17T03:16:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.158+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 --> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae60074cc0 con 0x7fae4007f120 2024-09-17T03:16:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae5d600640 1 -- 172.21.15.153:0/775943873 <== osd.6 v2:172.21.15.164:6802/3366340382 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae60074cc0 con 0x7fae4007f120 2024-09-17T03:16:36.158 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:36.158 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:36.158 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7fae4007f120 msgr2=0x7fae400815b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6802/3366340382,v1:172.21.15.164:6803/3366340382] conn(0x7fae4007f120 0x7fae400815b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fae40078b90 msgr2=0x7fae4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fae54009b30 tx=0x7fae54005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 msgr2=0x7fae6015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 --2- 172.21.15.153:0/775943873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6015cf50 0x7fae6015f4d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c3c0 tx=0x7fae4c00c880 comp rx=0 tx=0).stop 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66200640 1 -- 172.21.15.153:0/775943873 reap_dead start 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 shutdown_connections 2024-09-17T03:16:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 >> 172.21.15.153:0/775943873 conn(0x7fae6006cd90 msgr2=0x7fae6015e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 shutdown_connections 2024-09-17T03:16:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.159+0000 7fae66c00640 1 -- 172.21.15.153:0/775943873 wait complete. 2024-09-17T03:16:36.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 -- 172.21.15.153:0/1559204911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c0039e0 msgr2=0x7fd11c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1559204911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c0039e0 0x7fd11c003e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c390 tx=0x7fd11c005830 comp rx=0 tx=0).stop 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13a200640 1 -- 172.21.15.153:0/1559204911 reap_dead start 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 -- 172.21.15.153:0/1559204911 shutdown_connections 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 -- 172.21.15.153:0/1559204911 >> 172.21.15.153:0/1559204911 conn(0x7fd1340b19c0 msgr2=0x7fd1340b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 -- 172.21.15.153:0/1559204911 shutdown_connections 2024-09-17T03:16:36.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.406+0000 7fd13ac00640 1 -- 172.21.15.153:0/1559204911 wait complete. 2024-09-17T03:16:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.408+0000 7fd13ac00640 1 Processor -- start 2024-09-17T03:16:36.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.408+0000 7fd13ac00640 1 -- start start 2024-09-17T03:16:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd11c0039e0 0x7fd1340b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134151570 0x7fd13414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406f4e0 con 0x7fd1341f58d0 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406f360 con 0x7fd134151570 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd13ac00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd1340731b0 con 0x7fd11c0039e0 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd138e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd138e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42200/0 (socket says 172.21.15.153:42200) 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd138e00640 1 -- 172.21.15.153:0/1787940263 learned_addr learned my addr 172.21.15.153:0/1787940263 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.410+0000 7fd139800640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd11c0039e0 0x7fd1340b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd13a200640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134151570 0x7fd13414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 -- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd11c0039e0 msgr2=0x7fd1340b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd11c0039e0 0x7fd1340b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 -- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134151570 msgr2=0x7fd13414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134151570 0x7fd13414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 -- 172.21.15.153:0/1787940263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340b3ed0 con 0x7fd1341f58d0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd138e00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd120011b10 tx=0x7fd120009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12001e070 con 0x7fd1341f58d0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd120004050 con 0x7fd1341f58d0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd134151da0 con 0x7fd1341f58d0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.411+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000fea0 con 0x7fd1341f58d0 2024-09-17T03:16:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.412+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1340b4470 con 0x7fd1341f58d0 2024-09-17T03:16:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.413+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13415c630 con 0x7fd1341f58d0 2024-09-17T03:16:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.414+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd120021070 con 0x7fd1341f58d0 2024-09-17T03:16:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.415+0000 7fd131600640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 0x7fd11407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.415+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fd12009b670 con 0x7fd1341f58d0 2024-09-17T03:16:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.415+0000 7fd139800640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 0x7fd11407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.416+0000 7fd139800640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 0x7fd11407b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd128033000 tx=0x7fd128001a30 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.419+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd1200044a0 con 0x7fd1341f58d0 2024-09-17T03:16:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.602+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd1340b0630 con 0x7fd114078b90 2024-09-17T03:16:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.603+0000 7fd131600640 1 -- 172.21.15.153:0/1787940263 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1340b0630 con 0x7fd114078b90 2024-09-17T03:16:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T03:16:36.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 msgr2=0x7fd11407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 0x7fd11407b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd128033000 tx=0x7fd128001a30 comp rx=0 tx=0).stop 2024-09-17T03:16:36.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 msgr2=0x7fd134151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd120011b10 tx=0x7fd120009e90 comp rx=0 tx=0).stop 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 shutdown_connections 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fd114078b90 0x7fd11407b0a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd134151570 0x7fd13414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1341f58d0 0x7fd134151030 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 --2- 172.21.15.153:0/1787940263 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd11c0039e0 0x7fd1340b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 >> 172.21.15.153:0/1787940263 conn(0x7fd1340b19c0 msgr2=0x7fd1340cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 shutdown_connections 2024-09-17T03:16:36.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.605+0000 7fd13ac00640 1 -- 172.21.15.153:0/1787940263 wait complete. 2024-09-17T03:16:36.628 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T03:16:36.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:16:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 -- 172.21.15.153:0/323207269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 msgr2=0x7fa9340737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 --2- 172.21.15.153:0/323207269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9340737b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa92c005fd0 tx=0x7fa92c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 -- 172.21.15.153:0/323207269 shutdown_connections 2024-09-17T03:16:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 --2- 172.21.15.153:0/323207269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9340737b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 --2- 172.21.15.153:0/323207269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa934145c50 0x7fa9340b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 -- 172.21.15.153:0/323207269 >> 172.21.15.153:0/323207269 conn(0x7fa93406cd90 msgr2=0x7fa93406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 -- 172.21.15.153:0/323207269 shutdown_connections 2024-09-17T03:16:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.856+0000 7fa939c00640 1 -- 172.21.15.153:0/323207269 wait complete. 2024-09-17T03:16:36.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.858+0000 7fa939c00640 1 Processor -- start 2024-09-17T03:16:36.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.858+0000 7fa939c00640 1 -- start start 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9341526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9340ceee0 0x7fa934154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa934145c50 0x7fa934155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa934073e70 con 0x7fa9340b2130 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa934073cf0 con 0x7fa9340ceee0 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa939c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa934073ff0 con 0x7fa934145c50 2024-09-17T03:16:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa932a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9341526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa932a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9341526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42222/0 (socket says 172.21.15.153:42222) 2024-09-17T03:16:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.860+0000 7fa932a00640 1 -- 172.21.15.153:0/2303108693 learned_addr learned my addr 172.21.15.153:0/2303108693 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa92be00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9340ceee0 0x7fa934154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 -- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa934145c50 msgr2=0x7fa934155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa934145c50 0x7fa934155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 -- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9340ceee0 msgr2=0x7fa934154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9340ceee0 0x7fa934154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa934142930 con 0x7fa9340b2130 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa92be00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9340ceee0 0x7fa934154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa932a00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9341526b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c730 tx=0x7fa92400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924016020 con 0x7fa9340b2130 2024-09-17T03:16:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa92400a950 con 0x7fa9340b2130 2024-09-17T03:16:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa934144a40 con 0x7fa9340b2130 2024-09-17T03:16:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92400ada0 con 0x7fa9340b2130 2024-09-17T03:16:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.861+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa934145000 con 0x7fa9340b2130 2024-09-17T03:16:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.862+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa934074580 con 0x7fa9340b2130 2024-09-17T03:16:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.864+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa924019020 con 0x7fa9340b2130 2024-09-17T03:16:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92aa00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa910078bc0 0x7fa91007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fa9240992f0 con 0x7fa9340b2130 2024-09-17T03:16:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92be00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa910078bc0 0x7fa91007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92aa00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fa91007f150 0x7fa9100815e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa910081cb0 con 0x7fa91007f150 2024-09-17T03:16:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fa9240a0050 con 0x7fa9340b2130 2024-09-17T03:16:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.865+0000 7fa933400640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fa91007f150 0x7fa9100815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.866+0000 7fa92be00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa910078bc0 0x7fa91007b0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa9341416f0 tx=0x7fa91c005f90 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.866+0000 7fa933400640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fa91007f150 0x7fa9100815e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.867+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== osd.7 v2:172.21.15.164:6818/1373012278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa910081cb0 con 0x7fa91007f150 2024-09-17T03:16:36.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.881+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 --> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa9340b0b60 con 0x7fa91007f150 2024-09-17T03:16:36.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa92aa00640 1 -- 172.21.15.153:0/2303108693 <== osd.7 v2:172.21.15.164:6818/1373012278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa9340b0b60 con 0x7fa91007f150 2024-09-17T03:16:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-17T03:16:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:16:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-17T03:16:36.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fa91007f150 msgr2=0x7fa9100815e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6818/1373012278,v1:172.21.15.164:6819/1373012278] conn(0x7fa91007f150 0x7fa9100815e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa910078bc0 msgr2=0x7fa91007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fa910078bc0 0x7fa91007b0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa9341416f0 tx=0x7fa91c005f90 comp rx=0 tx=0).stop 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 msgr2=0x7fa9341526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.882+0000 7fa939c00640 1 --2- 172.21.15.153:0/2303108693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9340b2130 0x7fa9341526b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa92400c730 tx=0x7fa92400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.883+0000 7fa933400640 1 -- 172.21.15.153:0/2303108693 reap_dead start 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.883+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 shutdown_connections 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.883+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 >> 172.21.15.153:0/2303108693 conn(0x7fa93406cd90 msgr2=0x7fa9340afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.883+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 shutdown_connections 2024-09-17T03:16:36.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:36.883+0000 7fa939c00640 1 -- 172.21.15.153:0/2303108693 wait complete. 2024-09-17T03:16:36.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 -- 172.21.15.153:0/1498689480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 msgr2=0x7f6264003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 --2- 172.21.15.153:0/1498689480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6264003f10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6270009b50 tx=0x7f6264005830 comp rx=0 tx=0).stop 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f627e800640 1 -- 172.21.15.153:0/1498689480 reap_dead start 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 -- 172.21.15.153:0/1498689480 shutdown_connections 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 -- 172.21.15.153:0/1498689480 >> 172.21.15.153:0/1498689480 conn(0x7f62800d0070 msgr2=0x7f62800d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:37.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 -- 172.21.15.153:0/1498689480 shutdown_connections 2024-09-17T03:16:37.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.131+0000 7f6284c00640 1 -- 172.21.15.153:0/1498689480 wait complete. 2024-09-17T03:16:37.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.133+0000 7f6284c00640 1 Processor -- start 2024-09-17T03:16:37.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.134+0000 7f6284c00640 1 -- start start 2024-09-17T03:16:37.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62801f9b70 0x7f62800ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62800aec00 0x7f62801e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6280070760 con 0x7f6264003aa0 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f62800705e0 con 0x7f62801f9b70 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f6284c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f62800708e0 con 0x7f62800aec00 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f627de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f627de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42234/0 (socket says 172.21.15.153:42234) 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.135+0000 7f627de00640 1 -- 172.21.15.153:0/298265819 learned_addr learned my addr 172.21.15.153:0/298265819 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f6275400640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62801f9b70 0x7f62800ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627e800640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62800aec00 0x7f62801e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 -- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62800aec00 msgr2=0x7f62801e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62800aec00 0x7f62801e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 -- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62801f9b70 msgr2=0x7f62800ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62801f9b70 0x7f62800ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 -- 172.21.15.153:0/298265819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62800af310 con 0x7f6264003aa0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f627de00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6270009c70 tx=0x7f6270033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270038040 con 0x7f6264003aa0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6270004020 con 0x7f6264003aa0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.136+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62801f9090 con 0x7f6264003aa0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.137+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270004470 con 0x7f6264003aa0 2024-09-17T03:16:37.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.137+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801f65d0 con 0x7f6264003aa0 2024-09-17T03:16:37.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.138+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62801525f0 con 0x7f6264003aa0 2024-09-17T03:16:37.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.139+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6270045020 con 0x7f6264003aa0 2024-09-17T03:16:37.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.140+0000 7f6276a00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.140+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f62700bb5f0 con 0x7f6264003aa0 2024-09-17T03:16:37.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.140+0000 7f6275400640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.141+0000 7f6275400640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 0x7f625c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6268001af0 tx=0x7f6268001370 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:37.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.144+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6270083460 con 0x7f6264003aa0 2024-09-17T03:16:37.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.330+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f628009e0d0 con 0x7f625c078b90 2024-09-17T03:16:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.331+0000 7f6276a00640 1 -- 172.21.15.153:0/298265819 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f628009e0d0 con 0x7f625c078b90 2024-09-17T03:16:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T03:16:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 msgr2=0x7f625c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 0x7f625c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6268001af0 tx=0x7f6268001370 comp rx=0 tx=0).stop 2024-09-17T03:16:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 msgr2=0x7f6280150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6270009c70 tx=0x7f6270033670 comp rx=0 tx=0).stop 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 shutdown_connections 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62800aec00 0x7f62801e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62801f9b70 0x7f62800ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 --2- 172.21.15.153:0/298265819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264003aa0 0x7f6280150e60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 >> 172.21.15.153:0/298265819 conn(0x7f62800d0070 msgr2=0x7f6280159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 shutdown_connections 2024-09-17T03:16:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.333+0000 7f6284c00640 1 -- 172.21.15.153:0/298265819 wait complete. 2024-09-17T03:16:37.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:16:37.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 -- 172.21.15.153:0/578126447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf08073c40 msgr2=0x7faf08074050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 --2- 172.21.15.153:0/578126447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf08073c40 0x7faf08074050 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faf00005fd0 tx=0x7faf0002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 -- 172.21.15.153:0/578126447 shutdown_connections 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 --2- 172.21.15.153:0/578126447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf08073c40 0x7faf08074050 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 --2- 172.21.15.153:0/578126447 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 0x7faf08073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 -- 172.21.15.153:0/578126447 >> 172.21.15.153:0/578126447 conn(0x7faf080b19c0 msgr2=0x7faf080b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 -- 172.21.15.153:0/578126447 shutdown_connections 2024-09-17T03:16:37.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.575+0000 7faf0e600640 1 -- 172.21.15.153:0/578126447 wait complete. 2024-09-17T03:16:37.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.577+0000 7faf0e600640 1 Processor -- start 2024-09-17T03:16:37.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.578+0000 7faf0e600640 1 -- start start 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 0x7faf080b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf08073c40 0x7faf080b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf0815aec0 con 0x7faf080cb380 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf0815ad40 con 0x7faf08073c40 2024-09-17T03:16:37.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0e600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf0815b040 con 0x7faf080700e0 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42252/0 (socket says 172.21.15.153:42252) 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0dc00640 1 -- 172.21.15.153:0/1597071053 learned_addr learned my addr 172.21.15.153:0/1597071053 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.579+0000 7faf0d200640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 0x7faf080b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faeffe00640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf08073c40 0x7faf080b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 -- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 msgr2=0x7faf080b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 0x7faf080b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 -- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf08073c40 msgr2=0x7faf080b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf08073c40 0x7faf080b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 -- 172.21.15.153:0/1597071053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf080b4ad0 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0dc00640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faf00006010 tx=0x7faf00031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00031990 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf00031c20 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.580+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf080acfb0 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.581+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf000330d0 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.581+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf080aeb10 con 0x7faf080cb380 2024-09-17T03:16:37.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.582+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf080acda0 con 0x7faf080cb380 2024-09-17T03:16:37.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.583+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf00033270 con 0x7faf080cb380 2024-09-17T03:16:37.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.584+0000 7faf05600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 0x7faee407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:37.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.584+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7faf000bc090 con 0x7faf080cb380 2024-09-17T03:16:37.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.584+0000 7faf0d200640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 0x7faee407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:37.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.585+0000 7faf0d200640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 0x7faee407b0d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f60 tx=0x7faef8009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:37.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.588+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf0003f030 con 0x7faf080cb380 2024-09-17T03:16:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.770+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 --> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf080b4860 con 0x7faee4078bc0 2024-09-17T03:16:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.771+0000 7faf05600640 1 -- 172.21.15.153:0/1597071053 <== mgr.4117 v2:172.21.15.164:6800/275265985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13368 (secure 0 0 0) 0x7faf080b4860 con 0x7faee4078bc0 2024-09-17T03:16:37.771 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:37.771 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 msgr2=0x7faee407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 0x7faee407b0d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f60 tx=0x7faef8009040 comp rx=0 tx=0).stop 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 msgr2=0x7faf081e90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7faf00006010 tx=0x7faf00031700 comp rx=0 tx=0).stop 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 shutdown_connections 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7faee4078bc0 0x7faee407b0d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf080cb380 0x7faf081e90b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf08073c40 0x7faf080b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 --2- 172.21.15.153:0/1597071053 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080700e0 0x7faf080b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 >> 172.21.15.153:0/1597071053 conn(0x7faf080b19c0 msgr2=0x7faf0809ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 shutdown_connections 2024-09-17T03:16:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:37.774+0000 7faf0e600640 1 -- 172.21.15.153:0/1597071053 wait complete. 2024-09-17T03:16:37.797 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-17T03:16:36.865613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236148,"kb_used_data":7432,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738572,"statfs":{"total":773094113280,"available":772852297728,"internally_reserved":0,"allocated":7610368,"data_stored":4103696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"1.0","version":"67'74","reported_seq":198,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:16:33.281745+0000","last_change":"2024-09-17T03:16:33.281745+0000","last_active":"2024-09-17T03:16:33.281745+0000","last_peered":"2024-09-17T03:16:33.281745+0000","last_clean":"2024-09-17T03:16:33.281745+0000","last_became_active":"2024-09-17T03:13:24.789398+0000","last_became_peered":"2024-09-17T03:13:24.789398+0000","last_unstale":"2024-09-17T03:16:33.281745+0000","last_undegraded":"2024-09-17T03:16:33.281745+0000","last_fullsized":"2024-09-17T03:16:33.281745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'74","last_scrub_stamp":"2024-09-17T03:16:33.281645+0000","last_deep_scrub":"67'74","last_deep_scrub_stamp":"2024-09-17T03:16:33.281645+0000","last_clean_scrub_stamp":"2024-09-17T03:16:33.281645+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:07.138102+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":955738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":365370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:16:37.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T03:16:38.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.018+0000 7f600e200640 1 -- 172.21.15.153:0/2344717998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fec004040 msgr2=0x7f5fec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.018+0000 7f600e200640 1 --2- 172.21.15.153:0/2344717998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fec004040 0x7f5fec004800 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009b20 tx=0x7f5fec005830 comp rx=0 tx=0).stop 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.018+0000 7f6007e00640 1 -- 172.21.15.153:0/2344717998 reap_dead start 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.018+0000 7f600e200640 1 -- 172.21.15.153:0/2344717998 shutdown_connections 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.018+0000 7f600e200640 1 -- 172.21.15.153:0/2344717998 >> 172.21.15.153:0/2344717998 conn(0x7f600806cf70 msgr2=0x7f600806d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.019+0000 7f600e200640 1 -- 172.21.15.153:0/2344717998 shutdown_connections 2024-09-17T03:16:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.019+0000 7f600e200640 1 -- 172.21.15.153:0/2344717998 wait complete. 2024-09-17T03:16:38.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.021+0000 7f600e200640 1 Processor -- start 2024-09-17T03:16:38.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.021+0000 7f600e200640 1 -- start start 2024-09-17T03:16:38.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.022+0000 7f600e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec004040 0x7f600815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.022+0000 7f600e200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.022+0000 7f600e200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6008151aa0 0x7f60081f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.022+0000 7f600e200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60080b3db0 con 0x7f6008151690 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f600e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f60080b3f30 con 0x7f5fec004040 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f600e200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f60080b40b0 con 0x7f6008151aa0 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42270/0 (socket says 172.21.15.153:42270) 2024-09-17T03:16:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 -- 172.21.15.153:0/1625234449 learned_addr learned my addr 172.21.15.153:0/1625234449 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6007e00640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6008151aa0 0x7f60081f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6007400640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec004040 0x7f600815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 -- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6008151aa0 msgr2=0x7f60081f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6008151aa0 0x7f60081f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 -- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec004040 msgr2=0x7f600815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec004040 0x7f600815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.023+0000 7f6006a00640 1 -- 172.21.15.153:0/1625234449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081f7de0 con 0x7f6008151690 2024-09-17T03:16:38.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f6006a00640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009c40 tx=0x7f5ff4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4038050 con 0x7f6008151690 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ff4039040 con 0x7f6008151690 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60081e8790 con 0x7f6008151690 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4004280 con 0x7f6008151690 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.024+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60081573c0 con 0x7f6008151690 2024-09-17T03:16:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.025+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60081e8cb0 con 0x7f6008151690 2024-09-17T03:16:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.026+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ff4046020 con 0x7f6008151690 2024-09-17T03:16:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.027+0000 7f5fff400640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 0x7f5fe807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.027+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7f5ff40bb7c0 con 0x7f6008151690 2024-09-17T03:16:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.028+0000 7f6007400640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 0x7f5fe807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.028+0000 7f6007400640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 0x7f5fe807b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000fb0 tx=0x7f5ff80012b0 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.031+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ff4083db0 con 0x7f6008151690 2024-09-17T03:16:38.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.215+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f60080b2390 con 0x7f6008151690 2024-09-17T03:16:38.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.220+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v36)=0 v36) ==== 123+0+0 (secure 0 0 0) 0x7f5ff40836b0 con 0x7f6008151690 2024-09-17T03:16:38.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.221+0000 7f5fff400640 1 -- 172.21.15.153:0/1625234449 <== mon.0 v2:172.21.15.153:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f5ff40831c0 con 0x7f6008151690 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 msgr2=0x7f5fe807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 0x7f5fe807b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8000fb0 tx=0x7f5ff80012b0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 msgr2=0x7f60081f6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009c40 tx=0x7f5ff4005dc0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 shutdown_connections 2024-09-17T03:16:38.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7f5fe8078bc0 0x7f5fe807b0d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6008151aa0 0x7f60081f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6008151690 0x7f60081f6f60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 --2- 172.21.15.153:0/1625234449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec004040 0x7f600815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 >> 172.21.15.153:0/1625234449 conn(0x7f600806cf70 msgr2=0x7f6008155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 shutdown_connections 2024-09-17T03:16:38.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.223+0000 7f600e200640 1 -- 172.21.15.153:0/1625234449 wait complete. 2024-09-17T03:16:38.244 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:16:38.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 -- 172.21.15.153:0/1246619714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc68415f710 msgr2=0x7fc684151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 --2- 172.21.15.153:0/1246619714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc68415f710 0x7fc684151c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc684072850 tx=0x7fc67c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 -- 172.21.15.153:0/1246619714 shutdown_connections 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 --2- 172.21.15.153:0/1246619714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc68415f710 0x7fc684151c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 --2- 172.21.15.153:0/1246619714 >> v2:172.21.15.164:3300/0 conn(0x7fc6840cbf40 0x7fc6840705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 -- 172.21.15.153:0/1246619714 >> 172.21.15.153:0/1246619714 conn(0x7fc6840d0070 msgr2=0x7fc6840d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 -- 172.21.15.153:0/1246619714 shutdown_connections 2024-09-17T03:16:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.466+0000 7fc68a600640 1 -- 172.21.15.153:0/1246619714 wait complete. 2024-09-17T03:16:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.469+0000 7fc68a600640 1 Processor -- start 2024-09-17T03:16:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.469+0000 7fc68a600640 1 -- start start 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6840cbf40 0x7fc684151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc68415f710 0x7fc6841f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc684152510 con 0x7fc684070b20 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc684152390 con 0x7fc68415f710 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc68a600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc684152690 con 0x7fc6840cbf40 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc683400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc683400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42294/0 (socket says 172.21.15.153:42294) 2024-09-17T03:16:38.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.470+0000 7fc683400640 1 -- 172.21.15.153:0/1924241677 learned_addr learned my addr 172.21.15.153:0/1924241677 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683e00640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc68415f710 0x7fc6841f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc682a00640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6840cbf40 0x7fc684151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 -- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6840cbf40 msgr2=0x7fc684151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6840cbf40 0x7fc684151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 -- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc68415f710 msgr2=0x7fc6841f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc68415f710 0x7fc6841f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 -- 172.21.15.153:0/1924241677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6840cf7a0 con 0x7fc684070b20 2024-09-17T03:16:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc683400640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc67400d750 tx=0x7fc67400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674017070 con 0x7fc684070b20 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc674004330 con 0x7fc684070b20 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67400de60 con 0x7fc684070b20 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.471+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6840cfa80 con 0x7fc684070b20 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.472+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6841f6210 con 0x7fc684070b20 2024-09-17T03:16:38.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.473+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6840cfc50 con 0x7fc684070b20 2024-09-17T03:16:38.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.474+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc674009c30 con 0x7fc684070b20 2024-09-17T03:16:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.475+0000 7fc67b400640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 0x7fc66407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.475+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5421+0+0 (secure 0 0 0) 0x7fc67409afd0 con 0x7fc684070b20 2024-09-17T03:16:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.475+0000 7fc682a00640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 0x7fc66407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.476+0000 7fc682a00640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 0x7fc66407b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc684071780 tx=0x7fc670009040 comp rx=0 tx=0).ready entity=mgr.4117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:38.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.479+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc674020020 con 0x7fc684070b20 2024-09-17T03:16:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.697+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6840705e0 con 0x7fc684070b20 2024-09-17T03:16:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.698+0000 7fc67b400640 1 -- 172.21.15.153:0/1924241677 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3917 (secure 0 0 0) 0x7fc674063520 con 0x7fc684070b20 2024-09-17T03:16:38.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-17T03:16:38.697 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"btime":"2024-09-17T03:16:22:462369+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/446134552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":446134552},{"type":"v1","addr":"172.21.15.153:6834","nonce":446134552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5216,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4265279562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4265279562},{"type":"v1","addr":"172.21.15.153:6835","nonce":4265279562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/464129239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":464129239},{"type":"v1","addr":"172.21.15.164:6837","nonce":464129239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5668,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1204520485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1204520485},{"type":"v1","addr":"172.21.15.164:6836","nonce":1204520485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-09-17T03:16:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 43 2024-09-17T03:16:38.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 msgr2=0x7fc66407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 0x7fc66407b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc684071780 tx=0x7fc670009040 comp rx=0 tx=0).stop 2024-09-17T03:16:38.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 msgr2=0x7fc6840ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc67400d750 tx=0x7fc67400dc10 comp rx=0 tx=0).stop 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 shutdown_connections 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:6800/275265985,v1:172.21.15.164:6801/275265985] conn(0x7fc664078bc0 0x7fc66407b0d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc68415f710 0x7fc6841f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6840cbf40 0x7fc684151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 --2- 172.21.15.153:0/1924241677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684070b20 0x7fc6840ce650 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 >> 172.21.15.153:0/1924241677 conn(0x7fc6840d0070 msgr2=0x7fc6840b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 shutdown_connections 2024-09-17T03:16:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-17T03:16:38.700+0000 7fc68a600640 1 -- 172.21.15.153:0/1924241677 wait complete. 2024-09-17T03:16:38.722 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T03:16:38.722 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T03:16:38.722 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:16:38.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.742 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:16:38.743 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:16:38.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.808 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:16:38.808 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:16:38.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.832 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:16:38.832 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:16:38.832 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.896 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:16:38.896 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T03:16:38.896 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T03:16:38.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.944 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T03:16:38.944 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T03:16:38.945 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:38.997 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T03:16:38.997 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T03:16:38.997 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.052 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T03:16:39.052 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T03:16:39.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.125 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T03:16:39.125 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T03:16:39.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.178 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T03:16:39.178 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T03:16:39.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.240 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T03:16:39.240 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T03:16:39.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.289 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T03:16:39.290 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T03:16:39.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.350 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T03:16:39.350 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T03:16:39.351 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T03:16:39.351 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.422 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T03:16:39.422 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T03:16:39.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.497 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T03:16:39.497 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T03:16:39.497 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T03:16:39.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.526 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T03:16:39.526 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T03:16:39.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.552 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T03:16:39.552 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T03:16:39.552 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:39.619 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T03:16:39.619 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T03:16:39.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T03:16:39.699 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:39.699 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T03:16:39.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:39.937 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T03:16:40.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:40.076 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T03:16:40.182 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:40.183 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T03:16:40.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:16:40.282 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T03:16:40.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:16:40.440 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T03:16:40.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:16:40.541 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T03:16:40.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:16:40.667 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T03:16:40.799 INFO:tasks.ceph:Archiving mon data... 2024-09-17T03:16:40.800 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/data/mon.a.tgz 2024-09-17T03:16:40.801 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-17T03:16:40.836 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.Jz62L4tNPt 2024-09-17T03:16:40.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Jz62L4tNPt 2024-09-17T03:16:41.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.Jz62L4tNPt 2024-09-17T03:16:41.147 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.Jz62L4tNPt is 388KB 2024-09-17T03:16:41.236 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.Jz62L4tNPt 2024-09-17T03:16:41.271 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/data/mon.b.tgz 2024-09-17T03:16:41.272 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-17T03:16:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.83OcIdVoQ8 2024-09-17T03:16:41.309 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.83OcIdVoQ8 2024-09-17T03:16:41.524 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.83OcIdVoQ8 2024-09-17T03:16:41.619 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.83OcIdVoQ8 is 508KB 2024-09-17T03:16:41.711 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.83OcIdVoQ8 2024-09-17T03:16:41.747 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/data/mon.c.tgz 2024-09-17T03:16:41.748 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-17T03:16:41.822 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.Ppv8gyTflu 2024-09-17T03:16:41.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ppv8gyTflu 2024-09-17T03:16:42.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.Ppv8gyTflu 2024-09-17T03:16:42.118 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.Ppv8gyTflu is 508KB 2024-09-17T03:16:42.210 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.Ppv8gyTflu 2024-09-17T03:16:42.245 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T03:16:42.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:16:42.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:16:42.377 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:16:42.413 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:16:42.413 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T03:16:42.415 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi153/crash 2024-09-17T03:16:42.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:16:42.473 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi164/crash 2024-09-17T03:16:42.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:16:42.528 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T03:16:42.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:42.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:42.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:42.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:42.765 INFO:tasks.ceph:Compressing logs... 2024-09-17T03:16:42.765 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:16:42.769 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:16:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T03:16:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-09-17T03:16:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46501.log 2024-09-17T03:16:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51950.log 2024-09-17T03:16:42.822 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-09-17T03:16:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2024-09-17T03:16:42.823 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46501.log.gz 2024-09-17T03:16:42.824 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36213.log 2024-09-17T03:16:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54695.log 2024-09-17T03:16:42.824 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51950.log.gz 2024-09-17T03:16:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48620.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2024-09-17T03:16:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48242.log 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54023.log 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54695.log.gz 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48242.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.48242.log.gz 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44494.log 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54023.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54023.log.gz 2024-09-17T03:16:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53492.log 2024-09-17T03:16:42.830 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T03:16:42.830 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-09-17T03:16:42.830 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36213.log.gz 2024-09-17T03:16:42.830 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36093.log 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36093.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36093.log.gzgzip 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36013.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-09-17T03:16:42.831 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:16:42.834 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41365.log 2024-09-17T03:16:42.834 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41384.log 2024-09-17T03:16:42.834 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.41365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41365.log.gz 2024-09-17T03:16:42.834 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36373.log 2024-09-17T03:16:42.834 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:16:42.837 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44494.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44494.log.gz -5 2024-09-17T03:16:42.837 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2024-09-17T03:16:42.837 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53492.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53492.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48728.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49065.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54903.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51154.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54903.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.54903.log.gz 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53135.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52330.log 2024-09-17T03:16:42.838 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51154.log.gz 2024-09-17T03:16:42.839 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53135.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53135.log.gz 2024-09-17T03:16:42.839 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2024-09-17T03:16:42.839 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.52330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52330.log.gz 2024-09-17T03:16:42.839 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-09-17T03:16:42.852 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.41384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T03:16:42.853 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41384.log.gz 2024-09-17T03:16:42.853 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36373.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36373.log.gz 2024-09-17T03:16:42.853 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T03:16:42.853 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T03:16:42.853 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41779.log 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.3.41779.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.d.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41779.log.gz 2024-09-17T03:16:42.854 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T03:16:42.855 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36053.log 2024-09-17T03:16:42.855 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36053.log: 90.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T03:16:42.861 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41783.log 2024-09-17T03:16:42.861 INFO:teuthology.orchestra.run.smithi164.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36053.log.gz 2024-09-17T03:16:42.861 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2024-09-17T03:16:42.862 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.3.41783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41783.log.gz 2024-09-17T03:16:42.862 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36173.log 2024-09-17T03:16:42.862 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36133.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2024-09-17T03:16:42.872 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36173.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36173.log.gz 2024-09-17T03:16:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53450.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2024-09-17T03:16:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T03:16:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- 86.8% /var/log/ceph/ceph-client.admin.43952.log -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-09-17T03:16:42.875 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-17T03:16:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43952.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43952.log.gz -5 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41656.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41876.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.0.45633.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47127.log 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.45633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45633.log.gz 2024-09-17T03:16:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42260.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47127.log.gz 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48326.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42260.log.gz 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz -5 2024-09-17T03:16:42.877 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45766.log 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45766.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.45766.log.gz 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47805.log 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-09-17T03:16:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47805.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose 87.4% -- -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr: /var/log/ceph/ceph-client.admin.36190.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36190.log: 86.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.36190.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43947.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41834.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-09-17T03:16:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43947.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48494.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50944.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50944.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50944.log.gz 2024-09-17T03:16:42.880 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36922.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36628.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36922.log.gz 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51410.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36628.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36628.log.gz 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45614.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51410.log.gz 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-09-17T03:16:42.881 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.45614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45614.log.gz 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54149.log 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35832.log: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53230.log 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54149.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54149.log.gz 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47085.log 2024-09-17T03:16:42.882 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53230.log.gz 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54945.log 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47085.log.gz 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-09-17T03:16:42.887 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54945.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54945.log.gz 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48410.log 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48410.log.gz 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2024-09-17T03:16:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44259.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52752.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44259.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44259.log.gz 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52752.log.gz 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46070.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42134.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-09-17T03:16:42.889 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-09-17T03:16:42.891 INFO:teuthology.orchestra.run.smithi164.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.2.46070.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.2.46070.log.gz 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51028.log 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44907.log 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52668.log 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51028.log.gz 2024-09-17T03:16:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-09-17T03:16:42.894 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44907.log.gz 2024-09-17T03:16:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54317.log 2024-09-17T03:16:42.894 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52668.log.gz 2024-09-17T03:16:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-09-17T03:16:42.894 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-09-17T03:16:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54317.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54317.log.gz 2024-09-17T03:16:42.895 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-09-17T03:16:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2024-09-17T03:16:42.895 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-09-17T03:16:42.897 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-09-17T03:16:42.898 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-09-17T03:16:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-09-17T03:16:42.898 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2024-09-17T03:16:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45042.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-09-17T03:16:42.898 INFO:teuthology.orchestra.run.smithi153.stderr: /var/log/ceph/ceph-client.admin.47501.log 2024-09-17T03:16:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36271.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-09-17T03:16:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46074.log 2024-09-17T03:16:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.51806.log -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2024-09-17T03:16:42.901 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-17T03:16:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.2.46074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46074.log.gz 2024-09-17T03:16:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-09-17T03:16:42.903 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51806.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51806.log.gz 2024-09-17T03:16:42.903 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47211.log 2024-09-17T03:16:42.903 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-09-17T03:16:42.904 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-09-17T03:16:42.904 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36272.log 2024-09-17T03:16:42.904 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47211.log.gz 2024-09-17T03:16:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-17T03:16:42.905 INFO:teuthology.orchestra.run.smithi153.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-09-17T03:16:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36272.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36272.log.gz 2024-09-17T03:16:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47253.log 2024-09-17T03:16:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2024-09-17T03:16:42.906 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-17T03:16:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47253.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47253.log.gz 2024-09-17T03:16:42.907 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51718.log 2024-09-17T03:16:42.907 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48536.log 2024-09-17T03:16:42.907 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gz 2024-09-17T03:16:42.908 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54653.log 2024-09-17T03:16:42.908 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51718.log.gz 2024-09-17T03:16:42.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48070.log 2024-09-17T03:16:42.910 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48536.log.gz 2024-09-17T03:16:42.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54653.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54653.log.gz 2024-09-17T03:16:42.910 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-09-17T03:16:42.911 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T03:16:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48070.log: gzip -5 87.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48070.log.gz 2024-09-17T03:16:42.912 INFO:teuthology.orchestra.run.smithi153.stderr: /var/log/ceph/ceph-client.admin.36132.log 2024-09-17T03:16:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51249.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz -5 2024-09-17T03:16:42.912 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-09-17T03:16:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36132.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2024-09-17T03:16:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-09-17T03:16:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49253.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-09-17T03:16:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-17T03:16:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35779.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-09-17T03:16:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48112.log 2024-09-17T03:16:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36588.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54401.log 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48112.log.gz 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54401.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54401.log.gz 2024-09-17T03:16:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T03:16:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53408.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz --verbose 2024-09-17T03:16:42.921 INFO:teuthology.orchestra.run.smithi153.stderr: -- /var/log/ceph/ceph-client.admin.50435.log 2024-09-17T03:16:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53832.log 2024-09-17T03:16:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50435.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2024-09-17T03:16:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-09-17T03:16:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36251.log 2024-09-17T03:16:42.923 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53832.log.gz 2024-09-17T03:16:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54527.log 2024-09-17T03:16:42.924 INFO:teuthology.orchestra.run.smithi153.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-09-17T03:16:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53660.log 2024-09-17T03:16:42.924 INFO:teuthology.orchestra.run.smithi153.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36251.log.gz 2024-09-17T03:16:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35937.log 2024-09-17T03:16:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53660.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54527.log.gz 2024-09-17T03:16:42.926 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53660.log.gz 2024-09-17T03:16:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51764.log 2024-09-17T03:16:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35937.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-09-17T03:16:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-09-17T03:16:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-09-17T03:16:42.929 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51764.log.gz 2024-09-17T03:16:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44245.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2024-09-17T03:16:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53051.log 2024-09-17T03:16:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2024-09-17T03:16:42.931 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2024-09-17T03:16:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53051.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2024-09-17T03:16:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42218.log 2024-09-17T03:16:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-09-17T03:16:42.933 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-09-17T03:16:42.934 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-09-17T03:16:42.935 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42218.log.gz 2024-09-17T03:16:42.936 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50790.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-09-17T03:16:42.936 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2024-09-17T03:16:42.937 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-09-17T03:16:42.937 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-09-17T03:16:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50477.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2024-09-17T03:16:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-09-17T03:16:42.939 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2024-09-17T03:16:42.939 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35695.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-09-17T03:16:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-09-17T03:16:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-09-17T03:16:42.941 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-client.admin.47889.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T03:16:42.941 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2024-09-17T03:16:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-09-17T03:16:42.942 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-09-17T03:16:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54779.log 2024-09-17T03:16:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50729.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-09-17T03:16:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47931.log 2024-09-17T03:16:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54779.log: -- /var/log/ceph/ceph-client.admin.49155.log 2024-09-17T03:16:42.945 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54779.log.gz 2024-09-17T03:16:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47931.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47931.log.gz 2024-09-17T03:16:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42176.log 2024-09-17T03:16:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2024-09-17T03:16:42.947 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49155.log: /var/log/ceph/ceph-client.admin.42176.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-09-17T03:16:42.948 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-09-17T03:16:42.948 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42176.log.gz 2024-09-17T03:16:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2024-09-17T03:16:42.949 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz 2024-09-17T03:16:42.950 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49295.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2024-09-17T03:16:42.950 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46941.log 2024-09-17T03:16:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-09-17T03:16:42.951 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2024-09-17T03:16:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54275.log 2024-09-17T03:16:42.952 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2024-09-17T03:16:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42006.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz 2024-09-17T03:16:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2024-09-17T03:16:42.954 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2024-09-17T03:16:42.955 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54275.log.gz 2024-09-17T03:16:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43545.log 2024-09-17T03:16:42.955 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2024-09-17T03:16:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47847.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2024-09-17T03:16:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54359.log 2024-09-17T03:16:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-09-17T03:16:42.958 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43545.log.gz 2024-09-17T03:16:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52142.log 2024-09-17T03:16:42.959 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54359.log.gz 2024-09-17T03:16:42.960 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T03:16:42.960 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-09-17T03:16:42.961 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52142.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50519.log 2024-09-17T03:16:42.961 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52142.log.gz 2024-09-17T03:16:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43939.log 2024-09-17T03:16:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2024-09-17T03:16:42.963 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50519.log.gz 2024-09-17T03:16:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-09-17T03:16:42.965 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43939.log.gz 2024-09-17T03:16:42.966 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48368.log 2024-09-17T03:16:42.966 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2024-09-17T03:16:42.967 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47975.log: gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-09-17T03:16:42.967 INFO:teuthology.orchestra.run.smithi153.stderr: -- /var/log/ceph/ceph-client.admin.48154.log 2024-09-17T03:16:42.968 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48368.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48368.log.gz 2024-09-17T03:16:42.968 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2024-09-17T03:16:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51992.log/var/log/ceph/ceph-client.admin.48154.log: 2024-09-17T03:16:42.971 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2024-09-17T03:16:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51676.log: gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2024-09-17T03:16:42.971 INFO:teuthology.orchestra.run.smithi153.stderr: /var/log/ceph/ceph-client.admin.53009.log 2024-09-17T03:16:42.972 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T03:16:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51992.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51992.log.gz 2024-09-17T03:16:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2024-09-17T03:16:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54737.log 2024-09-17T03:16:42.973 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53009.log.gz 2024-09-17T03:16:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54485.log 2024-09-17T03:16:42.975 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2024-09-17T03:16:42.976 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54737.log: gzip 86.8% -- replaced with /var/log/ceph/ceph-client.admin.54737.log.gz 2024-09-17T03:16:42.976 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T03:16:42.977 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2024-09-17T03:16:42.977 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54485.log.gz 2024-09-17T03:16:42.978 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36205.log 2024-09-17T03:16:42.980 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51890.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2024-09-17T03:16:42.981 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2024-09-17T03:16:42.981 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36205.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36205.log.gz 2024-09-17T03:16:42.982 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29601.log 2024-09-17T03:16:42.983 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2024-09-17T03:16:42.983 INFO:teuthology.orchestra.run.smithi153.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T03:16:42.984 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50986.log 2024-09-17T03:16:42.984 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.tmp-client.admin.29601.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29601.log.gz 2024-09-17T03:16:42.985 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52818.log 2024-09-17T03:16:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50986.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36289.log 2024-09-17T03:16:42.986 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50986.log.gz 2024-09-17T03:16:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2024-09-17T03:16:42.987 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52818.log.gz 2024-09-17T03:16:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36289.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36289.log.gz 2024-09-17T03:16:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43773.log 2024-09-17T03:16:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44992.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2024-09-17T03:16:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:16:42.991 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48200.log 2024-09-17T03:16:42.991 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43773.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43773.log.gz 2024-09-17T03:16:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.48200.log: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:16:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-09-17T03:16:42.993 INFO:teuthology.orchestra.run.smithi153.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48200.log.gz 2024-09-17T03:16:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54443.log 2024-09-17T03:16:42.996 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47379.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-09-17T03:16:42.996 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-09-17T03:16:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-09-17T03:16:42.997 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54443.log.gz 2024-09-17T03:16:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51583.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-09-17T03:16:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2024-09-17T03:16:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47583.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-09-17T03:16:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45294.log 2024-09-17T03:16:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50341.log 2024-09-17T03:16:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49383.log: /var/log/ceph/ceph-client.admin.45294.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2024-09-17T03:16:43.002 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45294.log.gz 2024-09-17T03:16:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2024-09-17T03:16:43.003 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50341.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50341.log.gz 2024-09-17T03:16:43.003 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46864.log 2024-09-17T03:16:43.004 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2024-09-17T03:16:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53534.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz 2024-09-17T03:16:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46864.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2024-09-17T03:16:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36829.log 2024-09-17T03:16:43.007 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48019.log 2024-09-17T03:16:43.007 INFO:teuthology.orchestra.run.smithi153.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2024-09-17T03:16:43.008 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T03:16:43.008 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54107.log 2024-09-17T03:16:43.008 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36829.log.gz 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48019.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48019.log.gz 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54107.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54107.log.gz 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42090.log 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35665.log 2024-09-17T03:16:43.016 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42090.log.gz 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35665.log.gz 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-client.admin.36064.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43731.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-17T03:16:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2024-09-17T03:16:43.018 INFO:teuthology.orchestra.run.smithi153.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T03:16:43.018 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35759.log 2024-09-17T03:16:43.018 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-09-17T03:16:43.019 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44865.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2024-09-17T03:16:43.020 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-09-17T03:16:43.020 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-09-17T03:16:43.021 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35759.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.35759.log.gz 2024-09-17T03:16:43.021 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47678.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-09-17T03:16:43.021 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53618.log 2024-09-17T03:16:43.022 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47043.log 2024-09-17T03:16:43.023 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41962.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-09-17T03:16:43.024 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53618.log.gz 2024-09-17T03:16:43.024 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2024-09-17T03:16:43.024 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53790.log 2024-09-17T03:16:43.025 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47043.log: /var/log/ceph/ceph-client.admin.42932.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47043.log.gz 2024-09-17T03:16:43.026 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-09-17T03:16:43.027 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53790.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53790.log.gz 2024-09-17T03:16:43.028 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2024-09-17T03:16:43.028 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43335.log 2024-09-17T03:16:43.029 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-client.admin.44525.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-09-17T03:16:43.029 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-09-17T03:16:43.030 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43335.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43335.log.gz 2024-09-17T03:16:43.030 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51539.log 2024-09-17T03:16:43.030 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2024-09-17T03:16:43.031 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51539.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-09-17T03:16:43.032 INFO:teuthology.orchestra.run.smithi153.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz 2024-09-17T03:16:43.032 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2024-09-17T03:16:43.033 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54569.log 2024-09-17T03:16:43.034 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47295.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2024-09-17T03:16:43.034 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51329.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-09-17T03:16:43.034 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52334.log 2024-09-17T03:16:43.034 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2024-09-17T03:16:43.035 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54569.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54569.log.gz 2024-09-17T03:16:43.035 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.52334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52334.log.gz 2024-09-17T03:16:43.035 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2024-09-17T03:16:43.036 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-09-17T03:16:43.037 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54233.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2024-09-17T03:16:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48452.log 2024-09-17T03:16:43.038 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz 2024-09-17T03:16:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52478.log 2024-09-17T03:16:43.039 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-09-17T03:16:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48452.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48452.log.gz 2024-09-17T03:16:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-17T03:16:43.041 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-client.admin.52478.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52626.log 2024-09-17T03:16:43.041 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52478.log.gz 2024-09-17T03:16:43.042 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43689.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-17T03:16:43.042 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54821.log 2024-09-17T03:16:43.043 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-09-17T03:16:43.044 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52626.log.gz 2024-09-17T03:16:43.044 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54821.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.54821.log.gz 2024-09-17T03:16:43.044 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-09-17T03:16:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54611.log 2024-09-17T03:16:43.046 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46291.log: /var/log/ceph/ceph-client.admin.44611.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-09-17T03:16:43.047 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54863.log 2024-09-17T03:16:43.047 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-09-17T03:16:43.048 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48916.log 2024-09-17T03:16:43.049 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54611.log.gz 2024-09-17T03:16:43.049 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54863.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54863.log.gz 2024-09-17T03:16:43.049 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2024-09-17T03:16:43.051 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2024-09-17T03:16:43.051 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.48916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48916.log.gz 2024-09-17T03:16:43.051 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44627.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2024-09-17T03:16:43.051 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2024-09-17T03:16:43.053 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-client.admin.46375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53366.log 2024-09-17T03:16:43.053 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2024-09-17T03:16:43.054 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47337.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2024-09-17T03:16:43.054 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2024-09-17T03:16:43.055 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-09-17T03:16:43.056 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53366.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53366.log.gz 2024-09-17T03:16:43.056 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43377.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2024-09-17T03:16:43.056 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-09-17T03:16:43.058 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47763.log 2024-09-17T03:16:43.058 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-09-17T03:16:43.059 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51070.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-09-17T03:16:43.059 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2024-09-17T03:16:43.059 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2024-09-17T03:16:43.060 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47763.log: /var/log/ceph/ceph-client.admin.46774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47763.log.gz 2024-09-17T03:16:43.061 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gzgzip 2024-09-17T03:16:43.061 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44223.log 2024-09-17T03:16:43.061 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35887.log 2024-09-17T03:16:43.061 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2024-09-17T03:16:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48284.log 2024-09-17T03:16:43.063 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44223.log.gz 2024-09-17T03:16:43.064 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35887.log: 86.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.35887.log.gz 2024-09-17T03:16:43.065 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35646.log 2024-09-17T03:16:43.065 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-09-17T03:16:43.065 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48284.log.gz 2024-09-17T03:16:43.065 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.35646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35646.log.gz 2024-09-17T03:16:43.066 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-09-17T03:16:43.066 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-09-17T03:16:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54065.log 2024-09-17T03:16:43.068 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-09-17T03:16:43.069 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-09-17T03:16:43.069 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54065.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54065.log.gz 2024-09-17T03:16:43.069 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-09-17T03:16:43.071 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36076.log 2024-09-17T03:16:43.071 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36276.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-09-17T03:16:43.072 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43605.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-09-17T03:16:43.072 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48920.log 2024-09-17T03:16:43.072 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.36076.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T03:16:43.073 INFO:teuthology.orchestra.run.smithi153.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36076.log.gz 2024-09-17T03:16:43.073 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.48920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48920.log.gz 2024-09-17T03:16:43.073 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52076.log 2024-09-17T03:16:43.073 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T03:16:43.074 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.52076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52925.log 2024-09-17T03:16:43.074 INFO:teuthology.orchestra.run.smithi153.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52076.log.gz 2024-09-17T03:16:43.075 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52967.log 2024-09-17T03:16:43.077 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52925.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52925.log.gz 2024-09-17T03:16:43.078 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5/var/log/ceph/ceph-client.admin.52967.log: --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2024-09-17T03:16:43.078 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52967.log.gz 2024-09-17T03:16:43.079 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2024-09-17T03:16:43.080 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51112.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2024-09-17T03:16:43.081 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-09-17T03:16:43.082 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50832.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2024-09-17T03:16:43.083 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2024-09-17T03:16:43.084 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53324.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-09-17T03:16:43.085 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53576.log 2024-09-17T03:16:43.086 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45086.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2024-09-17T03:16:43.086 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47421.log 2024-09-17T03:16:43.086 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T03:16:43.087 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53576.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53576.log.gz 2024-09-17T03:16:43.088 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-09-17T03:16:43.089 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47421.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47421.log.gz 2024-09-17T03:16:43.089 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54191.log 2024-09-17T03:16:43.090 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43955.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-09-17T03:16:43.091 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51848.log 2024-09-17T03:16:43.092 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.54191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-09-17T03:16:43.092 INFO:teuthology.orchestra.run.smithi153.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54191.log.gz 2024-09-17T03:16:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51848.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51848.log.gz 2024-09-17T03:16:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51495.log 2024-09-17T03:16:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46696.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-09-17T03:16:43.095 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-09-17T03:16:43.096 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51495.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51495.log.gz 2024-09-17T03:16:43.097 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47628.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-09-17T03:16:43.242 INFO:teuthology.orchestra.run.smithi153.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T03:16:43.630 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T03:16:43.655 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T03:16:43.688 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T03:16:43.690 INFO:teuthology.orchestra.run.smithi153.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T03:16:43.715 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T03:16:43.735 INFO:teuthology.orchestra.run.smithi164.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T03:16:43.737 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-17T03:16:43.738 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m0.936s 2024-09-17T03:16:43.738 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m3.496s 2024-09-17T03:16:43.738 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.385s 2024-09-17T03:16:43.831 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T03:16:43.877 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T03:16:43.880 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-17T03:16:43.880 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m1.082s 2024-09-17T03:16:43.880 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m3.612s 2024-09-17T03:16:43.881 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.901s 2024-09-17T03:16:43.881 INFO:tasks.ceph:Archiving logs... 2024-09-17T03:16:43.882 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi153/log 2024-09-17T03:16:43.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:16:44.597 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi164/log 2024-09-17T03:16:44.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:16:45.114 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T03:16:45.124 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T03:16:45.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:16:45.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:16:45.240 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T03:16:45.249 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T03:16:45.249 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:16:45.257 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:16:45.283 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:16:45.290 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:16:45.290 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:16:45.290 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-17T03:16:45.291 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +1961us[+1948us] +/- 40ms 2024-09-17T03:16:45.291 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -882us[ -882us] +/- 77ms 2024-09-17T03:16:45.291 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -2835us[-2835us] +/- 82ms 2024-09-17T03:16:45.291 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:16:45.297 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:16:45.297 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-17T03:16:45.297 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +1996us[+2002us] +/- 40ms 2024-09-17T03:16:45.298 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -863us[ -863us] +/- 77ms 2024-09-17T03:16:45.298 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -2810us[-2810us] +/- 82ms 2024-09-17T03:16:45.298 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:16:45.299 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T03:16:45.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T03:16:45.309 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T03:16:45.337 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:16:45.461 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:16:45.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:16:45.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:45.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:16:45.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:45.698 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T03:16:45.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T03:16:45.790 INFO:teuthology.task.internal:Duration was 684.161784 seconds 2024-09-17T03:16:45.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T03:16:45.828 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T03:16:45.828 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:16:45.832 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:16:45.916 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:16:45.919 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:16:46.349 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T03:16:46.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-17T03:16:46.349 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:16:46.399 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-17T03:16:46.399 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:16:46.450 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T03:16:46.450 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:16:46.454 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:16:46.513 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T03:16:46.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:16:46.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:16:46.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T03:16:46.674 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T03:16:46.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:16:46.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:16:46.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T03:16:46.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:46.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:46.873 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-17T03:16:46.876 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-17T03:16:46.906 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:46.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:46.940 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:46.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:46.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T03:16:46.983 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T03:16:46.983 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi153 2024-09-17T03:16:46.984 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:16:47.049 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908408/remote/smithi164 2024-09-17T03:16:47.049 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:16:47.113 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T03:16:47.113 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:16:47.117 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:16:47.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T03:16:47.162 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T03:16:47.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T03:16:47.195 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T03:16:47.195 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:16:47.199 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:16:47.230 INFO:teuthology.orchestra.run.smithi153.stdout: 393247 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:16 /home/ubuntu/cephtest 2024-09-17T03:16:47.234 INFO:teuthology.orchestra.run.smithi164.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:16 /home/ubuntu/cephtest 2024-09-17T03:16:47.236 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T03:16:47.247 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T03:16:47.323 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/openfiletable} duration: 684.1617844104767 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T03:16:47.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:16:47.411 INFO:teuthology.run:pass